-- Logs begin at Mon 2022-07-11 13:53:04 UTC, end at Mon 2022-07-11 15:59:27 UTC. -- Jul 11 14:32:00.752683 dv-neutron-master-2-hyperv systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 14:32:00.761410 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 14:32:00 2022] *** Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: nodename: dv-neutron-master-2-hyperv Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: machine: x86_64 Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: clock source: unix Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: pcre jit disabled Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: detected number of CPU cores: 4 Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: current working directory: / Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: detected binary path: /usr/bin/uwsgi-core Jul 11 14:32:00.763299 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: your processes number limit is 47680 Jul 11 14:32:00.768368 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: your memory page size is 4096 bytes Jul 11 14:32:00.768368 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: detected max file descriptor number: 2048 Jul 11 14:32:00.768368 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: lock engine: pthread robust mutexes Jul 11 14:32:00.768368 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: thunder lock: enabled Jul 11 14:32:00.768368 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 14:32:00.768368 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 14:32:00.807929 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: Python main interpreter initialized at 0x562aad18b9c0 Jul 11 14:32:00.807929 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: python threads support enabled Jul 11 14:32:00.807929 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: your server socket listen backlog is limited to 100 connections Jul 11 14:32:00.807929 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: your mercy for graceful operations on workers is 90 seconds Jul 11 14:32:00.808479 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 14:32:00.808479 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: *** Operational MODE: preforking *** Jul 11 14:32:00.808614 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: *** uWSGI is running in multiple interpreter mode *** Jul 11 14:32:00.808614 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: spawned uWSGI master process (pid: 87415) Jul 11 14:32:00.808834 dv-neutron-master-2-hyperv systemd[1]: Started Devstack devstack@keystone.service. Jul 11 14:32:00.810601 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: spawned uWSGI worker 1 (pid: 87427, cores: 1) Jul 11 14:32:00.810601 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: spawned uWSGI worker 2 (pid: 87428, cores: 1) Jul 11 14:32:00.810601 dv-neutron-master-2-hyperv devstack@keystone.service[87415]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 14:32:06.226284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:32:06.226284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: from cryptography.utils import int_from_bytes Jul 11 14:32:06.227101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:32:06.227101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: from cryptography.utils import int_from_bytes Jul 11 14:32:06.227517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:32:06.227517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: from cryptography.utils import int_from_bytes Jul 11 14:32:06.227631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:32:06.227631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: from cryptography.utils import int_from_bytes Jul 11 14:32:06.276397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:32:06.276578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:32:06.276671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:32:06.276760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:32:06.276837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] command line args: [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:32:06.276909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] command line args: [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:32:06.277073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:32:06.277163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:32:06.277265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ================================================================================ {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:32:06.277345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ================================================================================ {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:32:06.277468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] admin_token = **** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.277618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] admin_token = **** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.277712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] config_dir = [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.277902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] config_dir = [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.277983 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.278089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] config_source = [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.278196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.278314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] debug = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.278452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] config_source = [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.278543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.278755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] debug = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.278961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] list_limit = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.279978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] log_config_append = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] list_limit = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] log_config_append = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] log_dir = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] log_file = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] log_dir = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] log_file = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.280965 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281369 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281739 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.281989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.282071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.282208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.282305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.282460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.282549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.282697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.282785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.282930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.283018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.283165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.283252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.283397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.283490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.283643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.283766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.283906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.284017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.284165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.284407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.284591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] publish_errors = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.284723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.284828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.284905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] publish_errors = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285620 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.285977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] standard_threads = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] standard_threads = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] use_journal = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.286995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] use_json = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] use_journal = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] use_stderr = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] use_json = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287296 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] use_syslog = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] use_stderr = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] use_syslog = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:32:06.287798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.287935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.288017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.288177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.288274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.288445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.288534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.288687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.288800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.288939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289738 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.289987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.290169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.290262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.290411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.290499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.290642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.290723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.290888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.290967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.291122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.291203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.291411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.291526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.291644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.291738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.291879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.291966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.292135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.292216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.292385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.292476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.292625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.292706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.292858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.292938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.293112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.293289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.293373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.293474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.293621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.293746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.293857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.293975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.294091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.294242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.294339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.294479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.294560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.294856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.294991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295495 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.295990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.296097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.296180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.296345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.296472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.296583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.296665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.296832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.296921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.297996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.298142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.298240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.298372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.298489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.298628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.298726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.298860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.298947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.299097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.299188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.299333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.299415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.299631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.299751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.299871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.300849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.301948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.302029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.302222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.302304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.302459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.302553 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.302693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.302780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.302923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.303981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.304137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.304219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.304400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.304479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.304636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.304716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.304869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.304945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.305112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.305196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.305343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.305424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.305578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.305659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.305808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.305888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.306054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.306154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.306317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.306412 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.306558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.306646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.306798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.306884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.307598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.307741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.307874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.308013 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.308141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.308282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.308416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.308557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.308557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.308806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.308934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.309061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.309187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.309322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.309456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.309585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.309712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.309839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.309967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.310138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.310267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.310406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.310556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.310680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.310808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.310945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.311073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.311201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.311328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.311455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.311584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.311717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.311855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.311984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.312111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.312238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.312362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.312500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.312628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.312757 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.312885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.313012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.313140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.313276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.313404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.313532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.313669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.313804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.313932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.314070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] auth.external = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.314237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] auth.external = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.314359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.314484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.314612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.314772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.314915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.315053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.315188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] auth.password = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.315317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] auth.password = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.315457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] auth.token = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.315587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] auth.token = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.315716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.315852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.315989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.316124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.316252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.316379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.316507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.316634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.316775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.316914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.317050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.317050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.317311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.317441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] credential.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.317576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.317704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.317831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] credential.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.317970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.318147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.318278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.318415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.318543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.318674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.318759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.318881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.319023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.319164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.319164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.319400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.319531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.319655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.319655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.319864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.320995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.321240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.321240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.321490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.321490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] federation.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.321732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.321862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.321994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] federation.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.321994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.322263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.322390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.322516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.322516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.323393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.323393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.323642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.323769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.323897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.324022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.324149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.324284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.324411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.324537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.324662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.324787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.324924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.325058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.325194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.325321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.325448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.325575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.325702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.325840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.325967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.326119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.326248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.326376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.326510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.326645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.326781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.326909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.327035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.327160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.327337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.327474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.327604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.327729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.327856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.327981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.328107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.328240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.328367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.328506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.328633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.328759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.328886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.329020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.329147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.329273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.329400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.329526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.329659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.329794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.329921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.330047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.330244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.330371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.330511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.330642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.330777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.330906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.331036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.331164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.331301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.331435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.331566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.331693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.331820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.331947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.332091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.332222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.332351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.332478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.332607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.332734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.332870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.332998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.333126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.333254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.333382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.333511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.333646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.333775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.333913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.334049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.334192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.334318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.334460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.334590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.334722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.334853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.334985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.335115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.335254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.335384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.335515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.335645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.335790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.335920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.336060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.336193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.336324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.336455 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.336586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.336716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.336856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.336994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.337126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.337256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.337387 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.337528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.337672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.337805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.337937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.338068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.338222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.338352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.338489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.338618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.338702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.338841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.339005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.339179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.339379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.339526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.339655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.339785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.339915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.340043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.340183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.340312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.340440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.340569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.340698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.340825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.340968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.341099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.341321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.341449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.341580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.341709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.341847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.341978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.342127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.342255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.342341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.342466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.342642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.342770 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.342897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.343024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.343161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.343289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.343424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.343551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.343678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.343804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.343930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.344056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.344191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.344318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.344443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.344570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.344696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.344829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.344966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.345092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.345220 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.345346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.345346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.345591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.345718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.345848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.345974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.346153 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.346283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.346485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.346616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.346755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.346884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.347011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.347140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.347277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.347412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.347541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.347669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.347799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.347883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.348060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.348187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.348318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.348448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.348586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.348714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.348849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.348978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] resource.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.349107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] resource.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.349234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.349363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.349491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.349626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.349755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.349883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.350010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.350156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.350282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.350428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.350561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.350692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.350822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.350953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.351083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.351222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.351353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.351485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.351614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] role.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.351745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] role.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.351876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] role.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.352014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] role.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.352145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.352289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.352421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.352554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.352685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.352825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.352956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.353088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.353219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.353350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.353486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.353627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.354298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.354429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.354569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.354700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.354828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.354968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.355099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.355226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.355354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.355481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.355609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.355751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.355880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.356010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.356143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.356282 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.356419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.356548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.356677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.356805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.356932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.357061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.357197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.357326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.357454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.357583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.357712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.357881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.358029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.358179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.358304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.358431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.358557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.358684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.358820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.358947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.359075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.359202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.359355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.359534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.359704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.359790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.359919 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.360099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.360234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.360386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.360526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.360655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.360782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.360910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.361036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.361163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.361297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.361445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.361525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] token.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.361729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] token.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.361858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.361986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.362148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.362277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.362405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.362536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.362663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.362791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.362929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.363059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.363187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.363315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.363443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.363580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.363716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.363845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.363977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.364107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.364231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.364361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.364498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.364627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.364755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.364882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.365010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.365139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.365274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.365274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.365526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.365526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.365772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.365900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.366037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.366037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.connection = **** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.366310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.366446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.366579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.connection = **** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.366720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.366860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.366993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.367147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.367277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.367409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.367541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.367673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.367805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.368009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.368144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.368277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.368409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.368542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.368672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.368811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.368943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.369086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.369219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.369352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.369513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.369656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.369786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.369918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.370003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.370068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.370216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.370842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.370973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.371104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.371231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.371375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.371508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.371596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.371781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:32:06.371908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:32:06.371908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:32:06.394927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.395264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.401845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.402008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.402114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.402201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.404056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.410067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.433722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.433950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.437277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.437514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.578769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.579009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.627887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.628118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.628920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.629165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.694320 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.694513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.694598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.694667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.694773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.694930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.695020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.695103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.695181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.695299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.695404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.695523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.720281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.720495 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.720623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.720730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.720811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.720926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.721019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.721142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.721226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.721359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.721445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.721573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.721658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.721794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.732794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.733186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.746454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.746705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.746796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.746889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.746959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.747104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.747191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.747741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.747822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.747890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.747953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.748016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.748079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.748079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:32:06.766146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.766349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:32:06.766688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.766783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.766882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:32:06.766962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:32:06.771444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.771564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.771707 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:32:06.771836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.771940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.772022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.772101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.772178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.772255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.772255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.779159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.779446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.779562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.779715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.779804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.779997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.780084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.780326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.788284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.788632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.791637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.791953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.792051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.792199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.792286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.792477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.792564 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.792756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.792842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.793015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.793101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.793282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.793358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.793550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.793624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.793818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.793901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.794090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.794184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.794388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.794462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.794660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.821292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.821628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.823520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.823796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.823945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.824235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.829114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.829334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.830127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.830239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.830334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.830334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.837064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.837346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.837492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.837784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.841824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.842138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.842292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.842461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.842605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.842731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.842856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.842975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.843137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.843245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.843415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.843502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.843694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.843795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.843962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.844232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.862191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.862473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.862873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.863164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.866961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.867873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.871352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.871648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.872080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.872379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.876751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.877524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.880365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.881170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.883993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.884297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.884588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.884810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.884897 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.885672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.885779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.885973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.886059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.886290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.886571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.886852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.905251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.905543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.905811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.906077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.906195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.906487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.906758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.907023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.913920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.914913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.915648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.915927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.916662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.916931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.919146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.919424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.919726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.919987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.920241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.920337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.920530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.920818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.921107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.921389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.934063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.934377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.934664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.934958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.935247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.935335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.935591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.935881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.936177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.936462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.936758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.936998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.937085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.937299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.955740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.956903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.967123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.967233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.967305 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.967372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.967436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.967500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.967578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.967578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.967578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.967746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.967746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.967746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.973520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.974683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.975193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.976283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.978426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.978714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.979161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.979451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.979692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.979846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.980164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.980444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.988537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.988826 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.989109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.989704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.989999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.990308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.997467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.997750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.998038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.998338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.998610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.998751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:32:06.998963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.999130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.999226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.999294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.999507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.999593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.999780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:06.999869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.000049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.000189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.000310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.000441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.000562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.000692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.000823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.000950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.001071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.001230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.001485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.001750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.002031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.002329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:32:07.039450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562aad18b9c0 pid: 87428 (default app) Jul 11 14:32:07.040637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562aad18b9c0 pid: 87427 (default app) Jul 11 14:32:07.043056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8472328-1d2e-4a4e-9f8e-914dbd5a3bc5 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:07.043342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8472328-1d2e-4a4e-9f8e-914dbd5a3bc5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:07.043618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8472328-1d2e-4a4e-9f8e-914dbd5a3bc5 None None] PATH_INFO: `/v3` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:07.047863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Mon Jul 11 14:32:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:15.810327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363aef9-d339-4923-ac78-059d7aae0a50 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:15.810887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363aef9-d339-4923-ac78-059d7aae0a50 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:15.810887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363aef9-d339-4923-ac78-059d7aae0a50 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:15.815281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:15.821634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:15.822174 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:15.822275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:15.893903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: INFO dbcounter [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] Registered counter for database keystone Jul 11 14:32:15.915869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG oslo_db.sqlalchemy.engines [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:32:15.922902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writer thread running {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:32:16.103093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG passlib.handlers.bcrypt [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87428) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 14:32:16.103514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG passlib.handlers.bcrypt [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87428) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 14:32:16.159323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:16.160963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:16.287470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 14:32:16.475561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363aef9-d339-4923-ac78-059d7aae0a50 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:16.545689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: INFO dbcounter [None req-e363aef9-d339-4923-ac78-059d7aae0a50 None None] Registered counter for database keystone Jul 11 14:32:16.565390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG oslo_db.sqlalchemy.engines [None req-e363aef9-d339-4923-ac78-059d7aae0a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:32:16.572221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writer thread running {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:32:16.689873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363aef9-d339-4923-ac78-059d7aae0a50 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:16.694210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd2e18-7654-49d7-919b-14a743ee87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:16.694872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2e18-7654-49d7-919b-14a743ee87b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:16.695161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2e18-7654-49d7-919b-14a743ee87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:16.695438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2e18-7654-49d7-919b-14a743ee87b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:16.704157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd2e18-7654-49d7-919b-14a743ee87b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:16.755613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3cdd2e18-7654-49d7-919b-14a743ee87b0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 14:32:16.755965 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd2e18-7654-49d7-919b-14a743ee87b0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:16.767733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jul 11 14:32:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:32:16.773788 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:16.788377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba439d-34c5-4fc5-869a-4a228d7f6ebf None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:16.792880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131b60a-9804-4461-8863-270df3532117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:16.793996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131b60a-9804-4461-8863-270df3532117 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:16.794320 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131b60a-9804-4461-8863-270df3532117 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:16.794606 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131b60a-9804-4461-8863-270df3532117 admin admin] PATH_INFO: `/v3/projects/6d6ad6c08bb2467485d9a32d65d47482` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:16.796108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131b60a-9804-4461-8863-270df3532117 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d6ad6c08bb2467485d9a32d65d47482)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:16.850241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b131b60a-9804-4461-8863-270df3532117 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 14:32:16.850844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131b60a-9804-4461-8863-270df3532117 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:16.855794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jul 11 14:32:16 2022] GET /identity/v3/projects/6d6ad6c08bb2467485d9a32d65d47482 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:18.847742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fd94-763a-4682-a9bd-7fc1d315b429 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:18.848263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fd94-763a-4682-a9bd-7fc1d315b429 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:18.848359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fd94-763a-4682-a9bd-7fc1d315b429 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:18.852437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:18.858462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e1ec3-3e88-4c81-8bb1-95b06c24ebb2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:18.858884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e1ec3-3e88-4c81-8bb1-95b06c24ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:18.859031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e1ec3-3e88-4c81-8bb1-95b06c24ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:18.877497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1a0e1ec3-3e88-4c81-8bb1-95b06c24ebb2 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:18.879044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1a0e1ec3-3e88-4c81-8bb1-95b06c24ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:18.886903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 14:32:18.909780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fd94-763a-4682-a9bd-7fc1d315b429 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:18.922603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fd94-763a-4682-a9bd-7fc1d315b429 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:18.926890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffae386-3ad9-4c2d-b9f1-3b7ad5b25bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:18.927523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffae386-3ad9-4c2d-b9f1-3b7ad5b25bab admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:18.927811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffae386-3ad9-4c2d-b9f1-3b7ad5b25bab admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:18.928092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffae386-3ad9-4c2d-b9f1-3b7ad5b25bab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:18.935844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffae386-3ad9-4c2d-b9f1-3b7ad5b25bab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:18.937625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffae386-3ad9-4c2d-b9f1-3b7ad5b25bab admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:18.947770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jul 11 14:32:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:32:18.953493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e1ec3-3e88-4c81-8bb1-95b06c24ebb2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:18.962829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e1ec3-3e88-4c81-8bb1-95b06c24ebb2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:18.968090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894d1a4-afa8-4469-a1e3-05427fc900ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:18.968960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894d1a4-afa8-4469-a1e3-05427fc900ac admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:18.969245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894d1a4-afa8-4469-a1e3-05427fc900ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:18.969522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894d1a4-afa8-4469-a1e3-05427fc900ac admin admin] PATH_INFO: `/v3/users/93482eec3eb5456081aa49110195cd04` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:18.970941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894d1a4-afa8-4469-a1e3-05427fc900ac admin admin] RBAC: Authorizing `identity:get_user(user_id=93482eec3eb5456081aa49110195cd04)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:18.972775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894d1a4-afa8-4469-a1e3-05427fc900ac admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:18.974394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jul 11 14:32:18 2022] GET /identity/v3/users/93482eec3eb5456081aa49110195cd04 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:21.053725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019bd56-bec7-4d7b-a47a-ca8248d7949c None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.054244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019bd56-bec7-4d7b-a47a-ca8248d7949c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.054244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019bd56-bec7-4d7b-a47a-ca8248d7949c None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.055586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:21.061180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a8c1-caa2-4e9f-93b2-c99d7f2c19d6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.061593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a8c1-caa2-4e9f-93b2-c99d7f2c19d6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.061795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a8c1-caa2-4e9f-93b2-c99d7f2c19d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.079424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-41d2a8c1-caa2-4e9f-93b2-c99d7f2c19d6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:21.080587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-41d2a8c1-caa2-4e9f-93b2-c99d7f2c19d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:21.091794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9a71-787f-4760-a6a5-639464e339fb None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.092083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9a71-787f-4760-a6a5-639464e339fb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.092360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9a71-787f-4760-a6a5-639464e339fb None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.093725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:21.098665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.098952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.099233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.139762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG passlib.handlers.bcrypt [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87427) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 14:32:21.140197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG passlib.handlers.bcrypt [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87427) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 14:32:21.163174 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:21.186129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:21.186641 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2a8c1-caa2-4e9f-93b2-c99d7f2c19d6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.187757 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:21.211295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.289658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:21.293640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2a8c1-caa2-4e9f-93b2-c99d7f2c19d6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.312290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.329313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e299-fedc-449a-a658-ba4e1778b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.330127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e299-fedc-449a-a658-ba4e1778b3af None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.330426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e299-fedc-449a-a658-ba4e1778b3af None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.330706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e299-fedc-449a-a658-ba4e1778b3af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.341476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6e299-fedc-449a-a658-ba4e1778b3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-fbd6e299-fedc-449a-a658-ba4e1778b3af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:21.352650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:21.354274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:21.355432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:32:21.360415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e299-fedc-449a-a658-ba4e1778b3af None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.415782 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31b573-bc0b-4418-abbb-8b9bf95eeceb None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.419017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.442959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.453545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31cc1b-66c6-4220-b541-affae56b5ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.454483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31cc1b-66c6-4220-b541-affae56b5ebe None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.454794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31cc1b-66c6-4220-b541-affae56b5ebe None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.455091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31cc1b-66c6-4220-b541-affae56b5ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.460974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e299-fedc-449a-a658-ba4e1778b3af None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.497557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.498245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.498534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.498818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.499584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:21.499895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.501291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.513452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:21.518978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.524951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31cc1b-66c6-4220-b541-affae56b5ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.526597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31cc1b-66c6-4220-b541-affae56b5ebe None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.617642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b7b8-5fb6-43f3-9518-90174a35003d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.624986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:32:21.631224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31cc1b-66c6-4220-b541-affae56b5ebe None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.634050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.653077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239b0eb-a197-408a-87b1-ed55a24d131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.653957 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b0eb-a197-408a-87b1-ed55a24d131e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.654280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b0eb-a197-408a-87b1-ed55a24d131e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.654563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b0eb-a197-408a-87b1-ed55a24d131e None admin] PATH_INFO: `/v3/users/93482eec3eb5456081aa49110195cd04` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.655784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239b0eb-a197-408a-87b1-ed55a24d131e None admin] RBAC: Authorizing `identity:get_user(user_id=93482eec3eb5456081aa49110195cd04)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.657253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239b0eb-a197-408a-87b1-ed55a24d131e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.658918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/users/93482eec3eb5456081aa49110195cd04 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:21.664248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239b0eb-a197-408a-87b1-ed55a24d131e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.679305 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.732272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31cc1b-66c6-4220-b541-affae56b5ebe None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.764136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239b0eb-a197-408a-87b1-ed55a24d131e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.768437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.769232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.769511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.769784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.789740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.791972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.799068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74503-5ee6-4df0-8c85-59e96cf1ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.799874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74503-5ee6-4df0-8c85-59e96cf1ae5b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.800161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74503-5ee6-4df0-8c85-59e96cf1ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.800444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74503-5ee6-4df0-8c85-59e96cf1ae5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.801645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74503-5ee6-4df0-8c85-59e96cf1ae5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.803110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74503-5ee6-4df0-8c85-59e96cf1ae5b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.804725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:21.810457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74503-5ee6-4df0-8c85-59e96cf1ae5b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:32:21.812266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:21.813131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:21.813976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:32:21.813976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:32:21.813976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:32:21.813976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:21.813976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:32:21.818967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.876465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.894784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.914566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74503-5ee6-4df0-8c85-59e96cf1ae5b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.921186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbdba3-c20b-413f-94ba-d4c1029e76bd None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.948815 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e81736-06db-4965-91e6-43e579db35a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.949475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e81736-06db-4965-91e6-43e579db35a2 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.949759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e81736-06db-4965-91e6-43e579db35a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.950041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e81736-06db-4965-91e6-43e579db35a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.950913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e81736-06db-4965-91e6-43e579db35a2 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.domain.id=default, user.id=93482eec3eb5456081aa49110195cd04) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:21.951230 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e81736-06db-4965-91e6-43e579db35a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.952697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e81736-06db-4965-91e6-43e579db35a2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.953788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c949ac8-fec7-4d8f-990d-f92635eb782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.954481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c949ac8-fec7-4d8f-990d-f92635eb782b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.954768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c949ac8-fec7-4d8f-990d-f92635eb782b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.955046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c949ac8-fec7-4d8f-990d-f92635eb782b None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.955766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c949ac8-fec7-4d8f-990d-f92635eb782b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:21.956071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c949ac8-fec7-4d8f-990d-f92635eb782b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.957436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c949ac8-fec7-4d8f-990d-f92635eb782b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.959548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/role_assignments?user.id=93482eec3eb5456081aa49110195cd04&scope.domain.id=default&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:21.985083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:24.184035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811597fc-87be-4086-8b65-1c8e6fd6c147 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.185088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811597fc-87be-4086-8b65-1c8e6fd6c147 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.185609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811597fc-87be-4086-8b65-1c8e6fd6c147 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.187226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:24.199952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033acff-8c60-4d57-a63e-e13be26da62a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.200867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033acff-8c60-4d57-a63e-e13be26da62a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.201350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033acff-8c60-4d57-a63e-e13be26da62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.227129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-3033acff-8c60-4d57-a63e-e13be26da62a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:24.228747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3033acff-8c60-4d57-a63e-e13be26da62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:24.320431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:24.356152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811597fc-87be-4086-8b65-1c8e6fd6c147 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:24.443795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320e9a-47b9-420c-a9d9-e9614bcc3b15 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.444423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320e9a-47b9-420c-a9d9-e9614bcc3b15 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.444917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320e9a-47b9-420c-a9d9-e9614bcc3b15 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.446529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:24.451714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1446-28eb-4f89-94f9-54b79cb87912 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.452245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1446-28eb-4f89-94f9-54b79cb87912 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.452725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1446-28eb-4f89-94f9-54b79cb87912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.495696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-49fb1446-28eb-4f89-94f9-54b79cb87912 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:24.497261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-49fb1446-28eb-4f89-94f9-54b79cb87912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:24.515647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811597fc-87be-4086-8b65-1c8e6fd6c147 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:24.573896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45a67b-0844-4e95-802b-9979ad457927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:24.575083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45a67b-0844-4e95-802b-9979ad457927 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.575602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45a67b-0844-4e95-802b-9979ad457927 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.576077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45a67b-0844-4e95-802b-9979ad457927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.594458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:24.596616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45a67b-0844-4e95-802b-9979ad457927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-cf45a67b-0844-4e95-802b-9979ad457927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:24.612564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:24.616275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:24.617055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 13/25] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:24.620585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45a67b-0844-4e95-802b-9979ad457927 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:24.632623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:24.638465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:24.667473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb1446-28eb-4f89-94f9-54b79cb87912 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:24.816721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45a67b-0844-4e95-802b-9979ad457927 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:24.888211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:24.888904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.889195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.889734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.890549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:24.890865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:24.892266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:24.911060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 14/27] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:24.918038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:24.921952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb1446-28eb-4f89-94f9-54b79cb87912 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:24.976249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24155687-ae9a-4194-b23f-9b225e27928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:24.976952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155687-ae9a-4194-b23f-9b225e27928e None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.977244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155687-ae9a-4194-b23f-9b225e27928e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.977528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155687-ae9a-4194-b23f-9b225e27928e None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.978354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24155687-ae9a-4194-b23f-9b225e27928e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:24.980389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24155687-ae9a-4194-b23f-9b225e27928e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:25.019019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:25.055861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a423c-287c-41f5-bf76-af63f4b38e4f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:25.107170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e17e-d70f-456a-bf90-ce8da0952049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:25.108060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e17e-d70f-456a-bf90-ce8da0952049 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.108348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e17e-d70f-456a-bf90-ce8da0952049 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.108626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e17e-d70f-456a-bf90-ce8da0952049 None admin] PATH_INFO: `/v3/users/93482eec3eb5456081aa49110195cd04` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.109928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e17e-d70f-456a-bf90-ce8da0952049 None admin] RBAC: Authorizing `identity:get_user(user_id=93482eec3eb5456081aa49110195cd04)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:25.111407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e17e-d70f-456a-bf90-ce8da0952049 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:25.113060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 15/28] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:24 2022] GET /identity/v3/users/93482eec3eb5456081aa49110195cd04 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:25.118594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f39d-5763-44c3-ad65-e644dc2caf5f None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.118909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f39d-5763-44c3-ad65-e644dc2caf5f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.119230 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f39d-5763-44c3-ad65-e644dc2caf5f None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.120542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 16/29] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:25.121618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8cf5-df2e-4fca-86e0-c952f793c8bc None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.121974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8cf5-df2e-4fca-86e0-c952f793c8bc None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.122288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8cf5-df2e-4fca-86e0-c952f793c8bc None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.127492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 17/30] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:25.127492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d8cf5-df2e-4fca-86e0-c952f793c8bc None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:25.187429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 14/31] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Jul 11 14:32:24 2022] POST /identity/v3/roles => generated 219 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:25.189250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760af9-bb28-4794-be7d-4c6534ac7cfe None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.189746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760af9-bb28-4794-be7d-4c6534ac7cfe None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.190265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760af9-bb28-4794-be7d-4c6534ac7cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.210906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-73760af9-bb28-4794-be7d-4c6534ac7cfe None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:25.213839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-73760af9-bb28-4794-be7d-4c6534ac7cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:25.250498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:25.299446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d8cf5-df2e-4fca-86e0-c952f793c8bc None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:25.341126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 15/32] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:25.342552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637116-25f0-421c-ab83-e0cb111f5497 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.342851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637116-25f0-421c-ab83-e0cb111f5497 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.343133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637116-25f0-421c-ab83-e0cb111f5497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.361224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c62d0-e7f8-49d1-ab11-949ab9751060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:25.362436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c62d0-e7f8-49d1-ab11-949ab9751060 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.362950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c62d0-e7f8-49d1-ab11-949ab9751060 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.363431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c62d0-e7f8-49d1-ab11-949ab9751060 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.365158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c62d0-e7f8-49d1-ab11-949ab9751060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:25.366892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c62d0-e7f8-49d1-ab11-949ab9751060 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:25.368833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 18/33] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:25.375205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c62d0-e7f8-49d1-ab11-949ab9751060 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:25.375377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-35637116-25f0-421c-ab83-e0cb111f5497 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:25.376652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-35637116-25f0-421c-ab83-e0cb111f5497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:25.458649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:25.491204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 16/34] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:25.492459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35637116-25f0-421c-ab83-e0cb111f5497 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:25.513984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c62d0-e7f8-49d1-ab11-949ab9751060 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:25.560670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bdf0f-503a-4564-9dbd-40be45a05936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:25.561914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdf0f-503a-4564-9dbd-40be45a05936 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.562249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdf0f-503a-4564-9dbd-40be45a05936 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.562542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdf0f-503a-4564-9dbd-40be45a05936 None admin] PATH_INFO: `/v3/domains/default/users/93482eec3eb5456081aa49110195cd04/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.565778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bdf0f-503a-4564-9dbd-40be45a05936 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=93482eec3eb5456081aa49110195cd04, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:25.567494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bdf0f-503a-4564-9dbd-40be45a05936 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:25.616606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:25.623854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35637116-25f0-421c-ab83-e0cb111f5497 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:25.660600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:25.661415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.661709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.661996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.673202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:25.674862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:32:25.695391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:25.696306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:25.697194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:32:25.697194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:32:25.697194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:32:25.697194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:25.697194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 17/35] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:25.697922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:25.813291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1361 bytes} [Mon Jul 11 14:32:25 2022] PUT /identity/v3/domains/default/users/93482eec3eb5456081aa49110195cd04/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:32:25.814689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bdf0f-503a-4564-9dbd-40be45a05936 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:25.824952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eeef1-cad6-4763-a54c-21a652bda41d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:25.873337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545456-6d98-4ceb-9e80-3dbd3ac1da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:25.874071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545456-6d98-4ceb-9e80-3dbd3ac1da31 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.874493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545456-6d98-4ceb-9e80-3dbd3ac1da31 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.874899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545456-6d98-4ceb-9e80-3dbd3ac1da31 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.875851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545456-6d98-4ceb-9e80-3dbd3ac1da31 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:25.877576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545456-6d98-4ceb-9e80-3dbd3ac1da31 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:25.893768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:25.936117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bdf0f-503a-4564-9dbd-40be45a05936 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:25.978050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Jul 11 14:32:25 2022] POST /identity/v3/roles => generated 225 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:25.978872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:25.979428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d5cd5-d83e-4c71-886e-cf64444e6c6a None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.979726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d5cd5-d83e-4c71-886e-cf64444e6c6a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.980013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d5cd5-d83e-4c71-886e-cf64444e6c6a None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.980626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.981155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.981690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:25.982223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 19/38] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:25.983680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:25.983680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:25.985092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:25.993471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2c10-8e36-423d-bb5c-3ca66ffdbd73 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:25.993471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2c10-8e36-423d-bb5c-3ca66ffdbd73 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:25.995419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2c10-8e36-423d-bb5c-3ca66ffdbd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.017954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-08ea2c10-8e36-423d-bb5c-3ca66ffdbd73 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:26.019292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-08ea2c10-8e36-423d-bb5c-3ca66ffdbd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:26.022006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:26.111330 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:26.115278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb98b1-591f-4569-992f-e207c57a3840 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.115579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb98b1-591f-4569-992f-e207c57a3840 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.115871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb98b1-591f-4569-992f-e207c57a3840 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.117274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 21/40] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:26.123481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff759f-91c7-47a4-8c57-a2d86ac3a31c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.124895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff759f-91c7-47a4-8c57-a2d86ac3a31c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.124895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff759f-91c7-47a4-8c57-a2d86ac3a31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.135238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 20/41] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:26.142420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:26.155209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-45ff759f-91c7-47a4-8c57-a2d86ac3a31c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:26.156489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-45ff759f-91c7-47a4-8c57-a2d86ac3a31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:26.243544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 22/42] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:26.244448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff759f-91c7-47a4-8c57-a2d86ac3a31c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:26.261593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1952592-d7d4-4b2f-b416-6aea8df5db7a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:26.294871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:26.303345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f77c9-a667-4b6e-90d5-d6e3b5cb192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:26.304044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f77c9-a667-4b6e-90d5-d6e3b5cb192f None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.304309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f77c9-a667-4b6e-90d5-d6e3b5cb192f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.304715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f77c9-a667-4b6e-90d5-d6e3b5cb192f None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.305447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f77c9-a667-4b6e-90d5-d6e3b5cb192f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:26.307099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f77c9-a667-4b6e-90d5-d6e3b5cb192f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:26.335288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:26.369549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff759f-91c7-47a4-8c57-a2d86ac3a31c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:26.402726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d2278-83aa-4234-a96e-cb6aac84ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:26.403512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2278-83aa-4234-a96e-cb6aac84ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.403798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2278-83aa-4234-a96e-cb6aac84ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.404076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2278-83aa-4234-a96e-cb6aac84ffc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.405501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d2278-83aa-4234-a96e-cb6aac84ffc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:26.406976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d2278-83aa-4234-a96e-cb6aac84ffc6 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:26.408901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 23/43] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:26.413525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d2278-83aa-4234-a96e-cb6aac84ffc6 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:26.421733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:32:26 2022] POST /identity/v3/projects => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:26.422700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f77c9-a667-4b6e-90d5-d6e3b5cb192f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:26.560861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f77c9-a667-4b6e-90d5-d6e3b5cb192f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:26.567830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d2278-83aa-4234-a96e-cb6aac84ffc6 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:26.605914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b8a69-66e5-4d03-a899-fba1202df535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:26.606662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b8a69-66e5-4d03-a899-fba1202df535 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.606957 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b8a69-66e5-4d03-a899-fba1202df535 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.607243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b8a69-66e5-4d03-a899-fba1202df535 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.608262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b8a69-66e5-4d03-a899-fba1202df535 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:26.610782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b8a69-66e5-4d03-a899-fba1202df535 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:26.617204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9315f8c-67ec-4feb-969e-6ac7fb900e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:26.618197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315f8c-67ec-4feb-969e-6ac7fb900e26 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.618964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315f8c-67ec-4feb-969e-6ac7fb900e26 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.619615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315f8c-67ec-4feb-969e-6ac7fb900e26 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.620866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9315f8c-67ec-4feb-969e-6ac7fb900e26 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:26.622930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9315f8c-67ec-4feb-969e-6ac7fb900e26 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:26.629532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:26.760863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:32:26 2022] POST /identity/v3/projects => generated 312 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:26.772023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Jul 11 14:32:26 2022] POST /identity/v3/roles => generated 223 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:27.932357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881241e0-fa60-4fa5-8d5c-37c3f0a3b9db None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:27.932906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881241e0-fa60-4fa5-8d5c-37c3f0a3b9db None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:27.932906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881241e0-fa60-4fa5-8d5c-37c3f0a3b9db None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:27.934336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:27.939460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82097-9503-4355-89f3-e49ece08ab24 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:27.939892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82097-9503-4355-89f3-e49ece08ab24 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:27.940033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82097-9503-4355-89f3-e49ece08ab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:27.956648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-91b82097-9503-4355-89f3-e49ece08ab24 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:27.957868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-91b82097-9503-4355-89f3-e49ece08ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:28.029394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:28.053033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881241e0-fa60-4fa5-8d5c-37c3f0a3b9db None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:28.080886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:28.154134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881241e0-fa60-4fa5-8d5c-37c3f0a3b9db None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:28.187119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd86441-4d1e-4850-a502-0e68bba5b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:28.187923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd86441-4d1e-4850-a502-0e68bba5b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:28.188211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd86441-4d1e-4850-a502-0e68bba5b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:28.188507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd86441-4d1e-4850-a502-0e68bba5b9b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:28.199094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd86441-4d1e-4850-a502-0e68bba5b9b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-cfd86441-4d1e-4850-a502-0e68bba5b9b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:28.206794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:28.207633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:28.208399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 24/49] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:28.214839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b82097-9503-4355-89f3-e49ece08ab24 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:28.311638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b82097-9503-4355-89f3-e49ece08ab24 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:28.337017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:28.346137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:28.352229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:28.352229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:28.352229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:28.352229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:28.352229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:28.352229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:28.362007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 26/50] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:28.367623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd86441-4d1e-4850-a502-0e68bba5b9b8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:28.454036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:28.468390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd86441-4d1e-4850-a502-0e68bba5b9b8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:28.501541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15db71-fd0d-4f9e-ab75-ff774b18da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:28.502457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15db71-fd0d-4f9e-ab75-ff774b18da35 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:28.502745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15db71-fd0d-4f9e-ab75-ff774b18da35 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:28.503025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15db71-fd0d-4f9e-ab75-ff774b18da35 None admin] PATH_INFO: `/v3/users/93482eec3eb5456081aa49110195cd04` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:28.504227 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15db71-fd0d-4f9e-ab75-ff774b18da35 None admin] RBAC: Authorizing `identity:get_user(user_id=93482eec3eb5456081aa49110195cd04)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:28.505689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15db71-fd0d-4f9e-ab75-ff774b18da35 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:28.507351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:28 2022] GET /identity/v3/users/93482eec3eb5456081aa49110195cd04 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:28.513309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:28.611385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e9ba5-83aa-4ac2-ac40-6211fd8b4e58 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:28.752441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c0c14-4bdd-4abe-8224-b809665383cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:28.753242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0c14-4bdd-4abe-8224-b809665383cb None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:28.753529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0c14-4bdd-4abe-8224-b809665383cb None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:28.753808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0c14-4bdd-4abe-8224-b809665383cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:28.755012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c0c14-4bdd-4abe-8224-b809665383cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:28.756454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c0c14-4bdd-4abe-8224-b809665383cb None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:28.758060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 27/52] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:28.764367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15db71-fd0d-4f9e-ab75-ff774b18da35 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:28.829840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6d18-f563-42e9-8e8a-6e6206c7ffce None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:28.830147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6d18-f563-42e9-8e8a-6e6206c7ffce None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:28.830432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6d18-f563-42e9-8e8a-6e6206c7ffce None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:28.831805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 28/53] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:28.836679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e85b79-f986-40aa-b3e5-f4486694b204 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:28.836970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e85b79-f986-40aa-b3e5-f4486694b204 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:28.837253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e85b79-f986-40aa-b3e5-f4486694b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:28.854727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-a2e85b79-f986-40aa-b3e5-f4486694b204 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:28.856031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a2e85b79-f986-40aa-b3e5-f4486694b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:28.870477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15db71-fd0d-4f9e-ab75-ff774b18da35 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:28.903850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:28.904503 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:28.904789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:28.905071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:28.905905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.domain.id=default, user.id=93482eec3eb5456081aa49110195cd04) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:28.906253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:28.906767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:28.907903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:28.913961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Jul 11 14:32:28 2022] GET /identity/v3/role_assignments?user.id=93482eec3eb5456081aa49110195cd04&scope.domain.id=default&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:28.924249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 29/55] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:28.948793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:28.971662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:29.059871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97a40-dc41-484e-be5d-4e73f5c69ca6 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:29.093954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21f313-be11-49ec-a468-06bd0b778f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:29.094789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f313-be11-49ec-a468-06bd0b778f79 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:29.095073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f313-be11-49ec-a468-06bd0b778f79 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:29.095357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f313-be11-49ec-a468-06bd0b778f79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:29.096559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21f313-be11-49ec-a468-06bd0b778f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:29.098008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21f313-be11-49ec-a468-06bd0b778f79 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:29.099676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:29.105871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e85b79-f986-40aa-b3e5-f4486694b204 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:29.203816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e85b79-f986-40aa-b3e5-f4486694b204 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:29.237366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2eab0-e3cc-4b57-9a4b-1881a707e34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:29.238029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2eab0-e3cc-4b57-9a4b-1881a707e34a None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:29.238344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2eab0-e3cc-4b57-9a4b-1881a707e34a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:29.238628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2eab0-e3cc-4b57-9a4b-1881a707e34a None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:29.239332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2eab0-e3cc-4b57-9a4b-1881a707e34a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:29.240767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2eab0-e3cc-4b57-9a4b-1881a707e34a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:29.330809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Jul 11 14:32:29 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:31.346302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3c7d-7524-4c79-bcf2-9eaaa533eff8 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:31.346817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3c7d-7524-4c79-bcf2-9eaaa533eff8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:31.346974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3c7d-7524-4c79-bcf2-9eaaa533eff8 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:31.348378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:31.353999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d3d4-fe09-4631-8f82-9deea9b28c39 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:31.354416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d3d4-fe09-4631-8f82-9deea9b28c39 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:31.354606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d3d4-fe09-4631-8f82-9deea9b28c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:31.371974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-85d6d3d4-fe09-4631-8f82-9deea9b28c39 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:31.373158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-85d6d3d4-fe09-4631-8f82-9deea9b28c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:31.401704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:31.437825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:31.461754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3c7d-7524-4c79-bcf2-9eaaa533eff8 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:31.546739 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:31.561815 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3c7d-7524-4c79-bcf2-9eaaa533eff8 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:31.595015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb957307-eedc-4b8e-8c3b-8e3385cb5272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:31.595867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957307-eedc-4b8e-8c3b-8e3385cb5272 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:31.596156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957307-eedc-4b8e-8c3b-8e3385cb5272 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:31.596482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957307-eedc-4b8e-8c3b-8e3385cb5272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:31.597610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb957307-eedc-4b8e-8c3b-8e3385cb5272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:31.599146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb957307-eedc-4b8e-8c3b-8e3385cb5272 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:31.600755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:31.606961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6d3d4-fe09-4631-8f82-9deea9b28c39 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:31.705483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6d3d4-fe09-4631-8f82-9deea9b28c39 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:31.739728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679960a-0ebe-4666-aa98-e18817fa226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:31.740415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679960a-0ebe-4666-aa98-e18817fa226f None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:31.740708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679960a-0ebe-4666-aa98-e18817fa226f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:31.741007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679960a-0ebe-4666-aa98-e18817fa226f None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:31.743964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679960a-0ebe-4666-aa98-e18817fa226f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:31.743964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679960a-0ebe-4666-aa98-e18817fa226f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:31.839778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:32:31 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:34.851115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740a01a-538e-409c-9cdc-f95bd70b2ea8 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:34.852145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740a01a-538e-409c-9cdc-f95bd70b2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:34.852632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740a01a-538e-409c-9cdc-f95bd70b2ea8 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:34.854317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:34.859894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7ae1-f77a-492c-adc0-9b0ec49efcc8 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:34.860673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7ae1-f77a-492c-adc0-9b0ec49efcc8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:34.861239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7ae1-f77a-492c-adc0-9b0ec49efcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:34.887127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-26be7ae1-f77a-492c-adc0-9b0ec49efcc8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:34.888676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-26be7ae1-f77a-492c-adc0-9b0ec49efcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:34.919674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:34.993771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:35.029757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740a01a-538e-409c-9cdc-f95bd70b2ea8 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:35.163764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740a01a-538e-409c-9cdc-f95bd70b2ea8 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:35.171836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce1ef-3f01-4656-8769-20a815227908 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.172431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce1ef-3f01-4656-8769-20a815227908 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.172946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce1ef-3f01-4656-8769-20a815227908 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.174445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 34/64] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:35.181092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edb675-0485-4088-977b-b68234b64598 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.181626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edb675-0485-4088-977b-b68234b64598 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.182123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edb675-0485-4088-977b-b68234b64598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.211908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-04edb675-0485-4088-977b-b68234b64598 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:35.213651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-04edb675-0485-4088-977b-b68234b64598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:35.217706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c871-ec48-4338-ae55-7c8e5b6a2430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:35.218543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c871-ec48-4338-ae55-7c8e5b6a2430 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.218828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c871-ec48-4338-ae55-7c8e5b6a2430 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.219158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c871-ec48-4338-ae55-7c8e5b6a2430 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.239069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3c871-ec48-4338-ae55-7c8e5b6a2430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-36d3c871-ec48-4338-ae55-7c8e5b6a2430 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:35.248073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:35.248966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:35.249766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 31/65] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:35.255424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c871-ec48-4338-ae55-7c8e5b6a2430 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:35.293034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:35.354253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:35.402061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edb675-0485-4088-977b-b68234b64598 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:35.432457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c871-ec48-4338-ae55-7c8e5b6a2430 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:35.486725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751d2c-c1cd-4576-a2f0-01c5b09dec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:35.487463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751d2c-c1cd-4576-a2f0-01c5b09dec2c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.487749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751d2c-c1cd-4576-a2f0-01c5b09dec2c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.488284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751d2c-c1cd-4576-a2f0-01c5b09dec2c None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.489177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78751d2c-c1cd-4576-a2f0-01c5b09dec2c None admin] RBAC: Adding query filter params (name=member) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:35.489489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78751d2c-c1cd-4576-a2f0-01c5b09dec2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:35.491068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78751d2c-c1cd-4576-a2f0-01c5b09dec2c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:35.498324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:35.501359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 32/67] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:35.502829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d9a1-714b-4c52-b700-c031918dfff9 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.503118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d9a1-714b-4c52-b700-c031918dfff9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.503462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d9a1-714b-4c52-b700-c031918dfff9 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.508950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 33/68] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:35.510674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cc6e-0a5a-421f-9ba4-27b272468346 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.510969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cc6e-0a5a-421f-9ba4-27b272468346 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.511248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cc6e-0a5a-421f-9ba4-27b272468346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.519819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edb675-0485-4088-977b-b68234b64598 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:35.529484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-64a4cc6e-0a5a-421f-9ba4-27b272468346 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:35.531032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-64a4cc6e-0a5a-421f-9ba4-27b272468346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:35.557548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382492-a1b5-464b-b573-ff6a88adf4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:35.558294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382492-a1b5-464b-b573-ff6a88adf4fe None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.558585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382492-a1b5-464b-b573-ff6a88adf4fe None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.558856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382492-a1b5-464b-b573-ff6a88adf4fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.571006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9382492-a1b5-464b-b573-ff6a88adf4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-f9382492-a1b5-464b-b573-ff6a88adf4fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:35.581133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:35.582007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:35.582852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 36/69] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:32:35.583497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382492-a1b5-464b-b573-ff6a88adf4fe None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:35.610344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 34/70] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:35.611668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0b00-e8fa-4441-937f-26c52cbe645e None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.611970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0b00-e8fa-4441-937f-26c52cbe645e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.612253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0b00-e8fa-4441-937f-26c52cbe645e None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.613536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 35/71] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:35.617530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a0b00-e8fa-4441-937f-26c52cbe645e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:35.627625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:35.691374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382492-a1b5-464b-b573-ff6a88adf4fe None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:35.725760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19f19b-0744-462a-a098-cf26ca81287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:35.726294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a0b00-e8fa-4441-937f-26c52cbe645e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:35.726686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f19b-0744-462a-a098-cf26ca81287f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.726977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f19b-0744-462a-a098-cf26ca81287f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.727262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f19b-0744-462a-a098-cf26ca81287f None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.743435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19f19b-0744-462a-a098-cf26ca81287f None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:35.745559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19f19b-0744-462a-a098-cf26ca81287f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:35.747326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 37/72] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:35 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:35.752536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b459b8-14d5-4e3a-9c53-c6a415627631 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.752536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b459b8-14d5-4e3a-9c53-c6a415627631 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.752536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b459b8-14d5-4e3a-9c53-c6a415627631 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.752536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 38/73] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:35.752536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfecbd-29e8-472a-8004-19b49bd92df5 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.752536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfecbd-29e8-472a-8004-19b49bd92df5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.753020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfecbd-29e8-472a-8004-19b49bd92df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.756811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:35.765970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:35.766695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.766981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.770767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.770767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:35.770767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:35.770962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c0bfecbd-29e8-472a-8004-19b49bd92df5 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:35.771031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:35.771111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c0bfecbd-29e8-472a-8004-19b49bd92df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:35.778779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 36/74] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:35.779619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:35.841740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 39/75] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:35.845117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:35.847018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfecbd-29e8-472a-8004-19b49bd92df5 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:35.879926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf07155-7379-45bd-a4de-351ee4e25bf1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:35.914784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253476a-9901-4b4a-b7fd-a298a607064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:35.915603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253476a-9901-4b4a-b7fd-a298a607064f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.915895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253476a-9901-4b4a-b7fd-a298a607064f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.916183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253476a-9901-4b4a-b7fd-a298a607064f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.926353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253476a-9901-4b4a-b7fd-a298a607064f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-6253476a-9901-4b4a-b7fd-a298a607064f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:35.934845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:35.935944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 37/76] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:32:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:35.939070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bff40f-9b5f-453c-8e0f-b434462d344e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.940015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bff40f-9b5f-453c-8e0f-b434462d344e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.940015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bff40f-9b5f-453c-8e0f-b434462d344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:35.956332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-38bff40f-9b5f-453c-8e0f-b434462d344e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:35.957521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-38bff40f-9b5f-453c-8e0f-b434462d344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:35.959622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfecbd-29e8-472a-8004-19b49bd92df5 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:35.988438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:35.993494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bda51a-7f3b-4c42-a7b7-aae4b9d56eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:35.994714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bda51a-7f3b-4c42-a7b7-aae4b9d56eae None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:35.995002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bda51a-7f3b-4c42-a7b7-aae4b9d56eae None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:35.995280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bda51a-7f3b-4c42-a7b7-aae4b9d56eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.024750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 38/77] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:36.025631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bff40f-9b5f-453c-8e0f-b434462d344e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.066004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bda51a-7f3b-4c42-a7b7-aae4b9d56eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.067531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bda51a-7f3b-4c42-a7b7-aae4b9d56eae None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.083656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:36.125304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bff40f-9b5f-453c-8e0f-b434462d344e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.158328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b01e4-9a85-483a-949d-77d8e2eaab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.159192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b01e4-9a85-483a-949d-77d8e2eaab77 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.159477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b01e4-9a85-483a-949d-77d8e2eaab77 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.159763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b01e4-9a85-483a-949d-77d8e2eaab77 None admin] PATH_INFO: `/v3/users/93482eec3eb5456081aa49110195cd04` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.160962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b01e4-9a85-483a-949d-77d8e2eaab77 None admin] RBAC: Authorizing `identity:get_user(user_id=93482eec3eb5456081aa49110195cd04)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.162452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b01e4-9a85-483a-949d-77d8e2eaab77 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.164094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/users/93482eec3eb5456081aa49110195cd04 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:36.164852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b01e4-9a85-483a-949d-77d8e2eaab77 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.170767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 40/79] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:36.171614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bda51a-7f3b-4c42-a7b7-aae4b9d56eae None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.202337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:36.273309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b01e4-9a85-483a-949d-77d8e2eaab77 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.284678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bda51a-7f3b-4c42-a7b7-aae4b9d56eae None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.300776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:36.309862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2205c5-6ee9-4371-b3ec-82329bc75ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.310694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2205c5-6ee9-4371-b3ec-82329bc75ec8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.310979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2205c5-6ee9-4371-b3ec-82329bc75ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.311262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2205c5-6ee9-4371-b3ec-82329bc75ec8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.315446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2205c5-6ee9-4371-b3ec-82329bc75ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.315446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2205c5-6ee9-4371-b3ec-82329bc75ec8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.315967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:36.316748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2205c5-6ee9-4371-b3ec-82329bc75ec8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.326592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.326592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.326592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.326592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.327888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:36.328200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.329612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.338257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:36.343132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.426454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2205c5-6ee9-4371-b3ec-82329bc75ec8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.440798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:36.447039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17939b2-d564-4be4-bb54-cf563619221b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.460834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6029a-6be7-4c70-b531-9b4377015717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.461628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6029a-6be7-4c70-b531-9b4377015717 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.461911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6029a-6be7-4c70-b531-9b4377015717 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.462216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6029a-6be7-4c70-b531-9b4377015717 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.473073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6029a-6be7-4c70-b531-9b4377015717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:36.480449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fc3b1-df11-4490-b2f3-e6d124640b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.481092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fc3b1-df11-4490-b2f3-e6d124640b75 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-68b6029a-6be7-4c70-b531-9b4377015717 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:36.481284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:36.482313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:36.488351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:36.489103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fc3b1-df11-4490-b2f3-e6d124640b75 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.489103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fc3b1-df11-4490-b2f3-e6d124640b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.489250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:36.489250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6029a-6be7-4c70-b531-9b4377015717 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.538511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:36.555740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fc3b1-df11-4490-b2f3-e6d124640b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.557944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fc3b1-df11-4490-b2f3-e6d124640b75 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.584874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6029a-6be7-4c70-b531-9b4377015717 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.618465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91985a0f-84e3-4c32-93b5-9d4f4b122b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.619878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91985a0f-84e3-4c32-93b5-9d4f4b122b9c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.620163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91985a0f-84e3-4c32-93b5-9d4f4b122b9c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.620435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91985a0f-84e3-4c32-93b5-9d4f4b122b9c None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.621637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91985a0f-84e3-4c32-93b5-9d4f4b122b9c None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.623109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91985a0f-84e3-4c32-93b5-9d4f4b122b9c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.624801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:36.626022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91985a0f-84e3-4c32-93b5-9d4f4b122b9c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.649374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:36.656405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:36.657221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fc3b1-df11-4490-b2f3-e6d124640b75 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.748251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91985a0f-84e3-4c32-93b5-9d4f4b122b9c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.770898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:36.771894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fc3b1-df11-4490-b2f3-e6d124640b75 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.783500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabc3ba-4de3-4947-9b7a-7b5fd61f5bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.784179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc3ba-4de3-4947-9b7a-7b5fd61f5bf8 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.784472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc3ba-4de3-4947-9b7a-7b5fd61f5bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.784784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc3ba-4de3-4947-9b7a-7b5fd61f5bf8 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.785502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabc3ba-4de3-4947-9b7a-7b5fd61f5bf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.787009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabc3ba-4de3-4947-9b7a-7b5fd61f5bf8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.807079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac88d1-a0a7-4258-aabe-eaadcb8c7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.807956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac88d1-a0a7-4258-aabe-eaadcb8c7cce None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.808244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac88d1-a0a7-4258-aabe-eaadcb8c7cce None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.808523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac88d1-a0a7-4258-aabe-eaadcb8c7cce None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.809725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac88d1-a0a7-4258-aabe-eaadcb8c7cce None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.811215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac88d1-a0a7-4258-aabe-eaadcb8c7cce None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.812848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 43/85] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:36.814822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac88d1-a0a7-4258-aabe-eaadcb8c7cce None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.874524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:36.879330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 43/86] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:32:36 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:36.880466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabc3ba-4de3-4947-9b7a-7b5fd61f5bf8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:36.920110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac88d1-a0a7-4258-aabe-eaadcb8c7cce None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:36.960600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:36.961370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:36.961576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:36.961863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:36.963214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:36.963535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:36.965077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:36.974935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:36.975699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:37.033916 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabc3ba-4de3-4947-9b7a-7b5fd61f5bf8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:37.071200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:37.072480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.072769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.073044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.073938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] RBAC: Adding query filter params (role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b, user.id=0e178b8fd2ed47c08546f05bd3e7f914) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:37.074323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:37.075792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:37.081658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 44/88] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/role_assignments?user.id=0e178b8fd2ed47c08546f05bd3e7f914&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:37.087153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:37.104933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af483786-f97a-4c65-a317-c733fd7eb138 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:37.139218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:37.148618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:37.157102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bc9da-8382-4328-a61f-d8367724bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:37.158351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bc9da-8382-4328-a61f-d8367724bc0c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.158852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bc9da-8382-4328-a61f-d8367724bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.159304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bc9da-8382-4328-a61f-d8367724bc0c None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.160969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bc9da-8382-4328-a61f-d8367724bc0c None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:37.162711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bc9da-8382-4328-a61f-d8367724bc0c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:37.167522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 45/89] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:36 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:37.168785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bc9da-8382-4328-a61f-d8367724bc0c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:37.234185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa8f3-cd78-47d8-b8e4-5cd7dad8cf23 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:37.282749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adaff1-fb77-437c-8b7e-c0b26018a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:37.283559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adaff1-fb77-437c-8b7e-c0b26018a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.284104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adaff1-fb77-437c-8b7e-c0b26018a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.284336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adaff1-fb77-437c-8b7e-c0b26018a9d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.313127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bc9da-8382-4328-a61f-d8367724bc0c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:37.363240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf405-7d06-4db3-9b29-3b2c82ec8090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:37.364134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf405-7d06-4db3-9b29-3b2c82ec8090 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.364423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf405-7d06-4db3-9b29-3b2c82ec8090 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.364713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf405-7d06-4db3-9b29-3b2c82ec8090 None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.365980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bf405-7d06-4db3-9b29-3b2c82ec8090 None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:37.367502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bf405-7d06-4db3-9b29-3b2c82ec8090 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:37.369208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:37 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:37.370029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf405-7d06-4db3-9b29-3b2c82ec8090 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:37.379943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adaff1-fb77-437c-8b7e-c0b26018a9d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:37.381433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adaff1-fb77-437c-8b7e-c0b26018a9d0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:37.447566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:37.481900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:37.545049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf405-7d06-4db3-9b29-3b2c82ec8090 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:37.597317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 45/91] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:37.599697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adaff1-fb77-437c-8b7e-c0b26018a9d0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:37.600765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:37.601443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.601731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.602015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.604685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b, user.id=93482eec3eb5456081aa49110195cd04) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:37.605010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:37.607658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:37.624421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:37 2022] GET /identity/v3/role_assignments?user.id=93482eec3eb5456081aa49110195cd04&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:37.625270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:37.756322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7c1e9-324b-4cb1-8f3d-3d2f7fb71018 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:37.786514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:37.799407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b90a7-42bb-42c7-b160-471605c345c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:37.799407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b90a7-42bb-42c7-b160-471605c345c0 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.799407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b90a7-42bb-42c7-b160-471605c345c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.799407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b90a7-42bb-42c7-b160-471605c345c0 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.800149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b90a7-42bb-42c7-b160-471605c345c0 None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:37.801843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b90a7-42bb-42c7-b160-471605c345c0 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:37.803911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 48/93] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:37 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:37.806059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adaff1-fb77-437c-8b7e-c0b26018a9d0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:37.809945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b90a7-42bb-42c7-b160-471605c345c0 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:37.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6c2e3-b521-4c54-a1ff-29ca744b8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:37.874809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6c2e3-b521-4c54-a1ff-29ca744b8c3b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.875099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6c2e3-b521-4c54-a1ff-29ca744b8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.875385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6c2e3-b521-4c54-a1ff-29ca744b8c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.896716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:37.936337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b90a7-42bb-42c7-b160-471605c345c0 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:37.973949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:37.975435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.975919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.976419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.977447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] RBAC: Adding query filter params (role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b, user.id=0e178b8fd2ed47c08546f05bd3e7f914) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:37.977977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:37.979735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:37.985955 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 49/94] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:37 2022] GET /identity/v3/role_assignments?user.id=0e178b8fd2ed47c08546f05bd3e7f914&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:37.991330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6c2e3-b521-4c54-a1ff-29ca744b8c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:37.993160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6c2e3-b521-4c54-a1ff-29ca744b8c3b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:38.108047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 46/95] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:38.114084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:38.188089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:38.237745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70707b-5602-488e-9359-0dd702f2599c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:38.277508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72468ccc-b95d-4dcd-8836-e08c2221e708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:38.278420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72468ccc-b95d-4dcd-8836-e08c2221e708 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:38.278711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72468ccc-b95d-4dcd-8836-e08c2221e708 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:38.278993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72468ccc-b95d-4dcd-8836-e08c2221e708 None admin] PATH_INFO: `/v3/projects/23fcaf4fbda648d280e68b95ef126e9e` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:38.280253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72468ccc-b95d-4dcd-8836-e08c2221e708 None admin] RBAC: Authorizing `identity:get_project(project_id=23fcaf4fbda648d280e68b95ef126e9e)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:38.281750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72468ccc-b95d-4dcd-8836-e08c2221e708 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:38.283615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 50/96] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:38 2022] GET /identity/v3/projects/23fcaf4fbda648d280e68b95ef126e9e => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:38.295245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6c2e3-b521-4c54-a1ff-29ca744b8c3b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:38.351191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:38.416729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6c2e3-b521-4c54-a1ff-29ca744b8c3b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:38.457218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f90d2d-7e78-49b0-b75e-851a9be2ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:38.457898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90d2d-7e78-49b0-b75e-851a9be2ed58 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:38.458208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90d2d-7e78-49b0-b75e-851a9be2ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:38.458499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90d2d-7e78-49b0-b75e-851a9be2ed58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:38.459346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f90d2d-7e78-49b0-b75e-851a9be2ed58 None admin] RBAC: Adding query filter params (role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=23fcaf4fbda648d280e68b95ef126e9e, user.id=0e178b8fd2ed47c08546f05bd3e7f914) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:38.459667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f90d2d-7e78-49b0-b75e-851a9be2ed58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:38.461145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f90d2d-7e78-49b0-b75e-851a9be2ed58 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:38.467801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 47/97] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:38 2022] GET /identity/v3/role_assignments?user.id=0e178b8fd2ed47c08546f05bd3e7f914&scope.project.id=23fcaf4fbda648d280e68b95ef126e9e&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:39.887985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656fbc-e293-48b6-b926-26267c15fc04 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:39.888486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656fbc-e293-48b6-b926-26267c15fc04 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:39.888558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656fbc-e293-48b6-b926-26267c15fc04 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:39.890208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 51/98] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:39.895378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d579f5-fb6f-44b9-85a6-2fe493d18fcd None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:39.895796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d579f5-fb6f-44b9-85a6-2fe493d18fcd None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:39.895961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d579f5-fb6f-44b9-85a6-2fe493d18fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:39.915257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a2d579f5-fb6f-44b9-85a6-2fe493d18fcd None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:39.916487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a2d579f5-fb6f-44b9-85a6-2fe493d18fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:40.012557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:40.032862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16895e4-b26d-4dee-b4f7-c30bbf0586dd None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.033167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16895e4-b26d-4dee-b4f7-c30bbf0586dd None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.033439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16895e4-b26d-4dee-b4f7-c30bbf0586dd None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.035240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 52/100] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:40.047564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb72eb-53ef-486a-9144-30f95f9d6ed9 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.047861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb72eb-53ef-486a-9144-30f95f9d6ed9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.048148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb72eb-53ef-486a-9144-30f95f9d6ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.057399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16895e4-b26d-4dee-b4f7-c30bbf0586dd None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:40.073101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-adcb72eb-53ef-486a-9144-30f95f9d6ed9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:40.074447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-adcb72eb-53ef-486a-9144-30f95f9d6ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:40.131975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:40.201107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:40.204458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36688-a46a-44ff-b404-c5370310fa22 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.204458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36688-a46a-44ff-b404-c5370310fa22 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.204458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36688-a46a-44ff-b404-c5370310fa22 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.210729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 50/102] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:40.218147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773d366-7bde-479d-9b59-9b24fbd72cc4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.218147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773d366-7bde-479d-9b59-9b24fbd72cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.218147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773d366-7bde-479d-9b59-9b24fbd72cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.243853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16895e4-b26d-4dee-b4f7-c30bbf0586dd None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:40.248572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1773d366-7bde-479d-9b59-9b24fbd72cc4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:40.249786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1773d366-7bde-479d-9b59-9b24fbd72cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:40.277405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:40.302746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c3bf0-e741-4ccc-9e25-cf513cbc11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:40.303742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3bf0-e741-4ccc-9e25-cf513cbc11b7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.304033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3bf0-e741-4ccc-9e25-cf513cbc11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.304316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3bf0-e741-4ccc-9e25-cf513cbc11b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.327102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c3bf0-e741-4ccc-9e25-cf513cbc11b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-c52c3bf0-e741-4ccc-9e25-cf513cbc11b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:40.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:40.338829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:40.339619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 53/103] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:40.340254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c3bf0-e741-4ccc-9e25-cf513cbc11b7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:40.352471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 51/104] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:40.356127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773d366-7bde-479d-9b59-9b24fbd72cc4 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:40.457227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c3bf0-e741-4ccc-9e25-cf513cbc11b7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:40.496413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa3133-cd57-4f8d-b449-c52cadc29e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:40.497316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa3133-cd57-4f8d-b449-c52cadc29e0a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.497636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa3133-cd57-4f8d-b449-c52cadc29e0a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.497893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa3133-cd57-4f8d-b449-c52cadc29e0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.499240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa3133-cd57-4f8d-b449-c52cadc29e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:40.500814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa3133-cd57-4f8d-b449-c52cadc29e0a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:40.502621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 54/105] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:40.503398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa3133-cd57-4f8d-b449-c52cadc29e0a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:40.517398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:40.528724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773d366-7bde-479d-9b59-9b24fbd72cc4 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:40.568848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:40.592234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:40.592922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.593218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.593501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.594305 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] RBAC: Adding query filter params (name=member) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:40.594619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:40.596032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:40.613404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 52/106] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:40.614257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:40.629548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa3133-cd57-4f8d-b449-c52cadc29e0a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:40.696827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8d7c3-c550-441f-b803-17915be234e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:40.697669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d7c3-c550-441f-b803-17915be234e2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.697959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d7c3-c550-441f-b803-17915be234e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.698315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d7c3-c550-441f-b803-17915be234e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.718252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8d7c3-c550-441f-b803-17915be234e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-bbd8d7c3-c550-441f-b803-17915be234e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:40.730868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:40.731754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:40.732524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 55/107] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:40.733622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8d7c3-c550-441f-b803-17915be234e2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:40.791954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b26f-393c-4c94-a0c1-ca3d22a67a88 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:40.831993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56becf0-3f1d-4a90-9ad9-9054a657be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:40.833246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56becf0-3f1d-4a90-9ad9-9054a657be5c None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.833636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56becf0-3f1d-4a90-9ad9-9054a657be5c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.834018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56becf0-3f1d-4a90-9ad9-9054a657be5c None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.835234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56becf0-3f1d-4a90-9ad9-9054a657be5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:40.837393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56becf0-3f1d-4a90-9ad9-9054a657be5c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:40.860206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8d7c3-c550-441f-b803-17915be234e2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:40.875110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:40.896779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c56351-6fe0-40d5-95b7-4838132bb718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:40.897667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56351-6fe0-40d5-95b7-4838132bb718 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.897952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56351-6fe0-40d5-95b7-4838132bb718 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.898302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56351-6fe0-40d5-95b7-4838132bb718 None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.899515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56351-6fe0-40d5-95b7-4838132bb718 None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:40.901697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56351-6fe0-40d5-95b7-4838132bb718 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:40.908164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 56/108] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:40 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:40.908164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fc9c8-24a2-4fb7-a2d7-05fb12bf8716 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:40.908164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fc9c8-24a2-4fb7-a2d7-05fb12bf8716 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:40.908164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fc9c8-24a2-4fb7-a2d7-05fb12bf8716 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:40.908164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 57/109] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:40.908164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fc9c8-24a2-4fb7-a2d7-05fb12bf8716 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:40.976772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 53/110] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:32:40 2022] POST /identity/v3/projects => generated 302 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:40.977882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56becf0-3f1d-4a90-9ad9-9054a657be5c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:40.995673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:41.086872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fc9c8-24a2-4fb7-a2d7-05fb12bf8716 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:41.116488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56becf0-3f1d-4a90-9ad9-9054a657be5c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:41.164659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a59129-3aa0-4078-8a31-d5b35e40ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:41.165754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a59129-3aa0-4078-8a31-d5b35e40ca1e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.166157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a59129-3aa0-4078-8a31-d5b35e40ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.166487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a59129-3aa0-4078-8a31-d5b35e40ca1e None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.167807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a59129-3aa0-4078-8a31-d5b35e40ca1e None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:41.168656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0deebe-c307-4c88-9e75-3e887fc58475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:41.169400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0deebe-c307-4c88-9e75-3e887fc58475 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.169502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a59129-3aa0-4078-8a31-d5b35e40ca1e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:41.169693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0deebe-c307-4c88-9e75-3e887fc58475 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.169978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0deebe-c307-4c88-9e75-3e887fc58475 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.170792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0deebe-c307-4c88-9e75-3e887fc58475 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:41.171103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0deebe-c307-4c88-9e75-3e887fc58475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:41.171519 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 54/111] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:40 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:41.172786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c1d9-26b9-4e06-966b-30a7d1ffdf18 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.173078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c1d9-26b9-4e06-966b-30a7d1ffdf18 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.173259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0deebe-c307-4c88-9e75-3e887fc58475 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:41.173349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c1d9-26b9-4e06-966b-30a7d1ffdf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.184093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 58/112] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:41.185396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe83f3e-e95f-462f-9b2a-5bb8887c4373 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.185690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe83f3e-e95f-462f-9b2a-5bb8887c4373 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.185975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe83f3e-e95f-462f-9b2a-5bb8887c4373 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.187834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 59/113] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:41.188989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe83f3e-e95f-462f-9b2a-5bb8887c4373 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:41.200477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9b29c1d9-26b9-4e06-966b-30a7d1ffdf18 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:41.201999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9b29c1d9-26b9-4e06-966b-30a7d1ffdf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:41.249351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:41.287646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 55/114] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:41.288886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c1d9-26b9-4e06-966b-30a7d1ffdf18 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:41.307358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:41.334954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe83f3e-e95f-462f-9b2a-5bb8887c4373 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:41.385307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb6a1-ba4b-4065-bf02-46c8c87cf9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:41.386164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb6a1-ba4b-4065-bf02-46c8c87cf9fd None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.387339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb6a1-ba4b-4065-bf02-46c8c87cf9fd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.387339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb6a1-ba4b-4065-bf02-46c8c87cf9fd None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/users/0e178b8fd2ed47c08546f05bd3e7f914/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.389142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb6a1-ba4b-4065-bf02-46c8c87cf9fd None admin] RBAC: Authorizing `identity:create_grant(project_id=efca54e53d414d1c9c96a76b5d58a31b, user_id=0e178b8fd2ed47c08546f05bd3e7f914, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:41.391217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb6a1-ba4b-4065-bf02-46c8c87cf9fd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:41.413055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c1d9-26b9-4e06-966b-30a7d1ffdf18 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:41.451152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538fad-8ff8-44d6-a23a-96d16fa6a4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:41.452047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538fad-8ff8-44d6-a23a-96d16fa6a4ff None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.452335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538fad-8ff8-44d6-a23a-96d16fa6a4ff None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.452617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538fad-8ff8-44d6-a23a-96d16fa6a4ff None admin] PATH_INFO: `/v3/users/e1f2ec806588442cba97ea0b8449fd57` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.478504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 60/115] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:41 2022] PUT /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/users/0e178b8fd2ed47c08546f05bd3e7f914/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:32:41.480174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ecce-638d-49a9-be5e-ceb4cb0a472a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.490358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ecce-638d-49a9-be5e-ceb4cb0a472a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.490358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ecce-638d-49a9-be5e-ceb4cb0a472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.530566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8538fad-8ff8-44d6-a23a-96d16fa6a4ff None admin] RBAC: Authorizing `identity:get_user(user_id=e1f2ec806588442cba97ea0b8449fd57)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:41.531796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5139ecce-638d-49a9-be5e-ceb4cb0a472a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:41.532223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8538fad-8ff8-44d6-a23a-96d16fa6a4ff None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:41.533478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5139ecce-638d-49a9-be5e-ceb4cb0a472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:41.539168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 56/116] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:41 2022] GET /identity/v3/users/e1f2ec806588442cba97ea0b8449fd57 => generated 289 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:41.540230 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538fad-8ff8-44d6-a23a-96d16fa6a4ff None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:41.622332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:41.642696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 61/117] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:41.643932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86153541-25c2-4d58-8aba-ced9aed73d80 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.647645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86153541-25c2-4d58-8aba-ced9aed73d80 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.647942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86153541-25c2-4d58-8aba-ced9aed73d80 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.649580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 62/118] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:41.650461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86153541-25c2-4d58-8aba-ced9aed73d80 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:41.668015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538fad-8ff8-44d6-a23a-96d16fa6a4ff None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:41.692146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:41.709044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ca77c-aa29-40c7-bdd7-27197ab08fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:41.710036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca77c-aa29-40c7-bdd7-27197ab08fad None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.710371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca77c-aa29-40c7-bdd7-27197ab08fad None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.710655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca77c-aa29-40c7-bdd7-27197ab08fad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.722076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ca77c-aa29-40c7-bdd7-27197ab08fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-211ca77c-aa29-40c7-bdd7-27197ab08fad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:41.733113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:41.734049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:41.734875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 57/119] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:41.736342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6749-0b46-4b27-8721-a50227e1a3b0 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.736443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6749-0b46-4b27-8721-a50227e1a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.737703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6749-0b46-4b27-8721-a50227e1a3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.761646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a52c6749-0b46-4b27-8721-a50227e1a3b0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:41.762878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a52c6749-0b46-4b27-8721-a50227e1a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:41.772694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86153541-25c2-4d58-8aba-ced9aed73d80 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:41.811643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fa49-37fe-44ba-8594-052e2bdcd755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:41.812306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fa49-37fe-44ba-8594-052e2bdcd755 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.812653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fa49-37fe-44ba-8594-052e2bdcd755 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.812939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fa49-37fe-44ba-8594-052e2bdcd755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.834762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:41.835422 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6749-0b46-4b27-8721-a50227e1a3b0 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:41.892965 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43fa49-37fe-44ba-8594-052e2bdcd755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:41.894618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43fa49-37fe-44ba-8594-052e2bdcd755 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:41.896099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:41.942851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:41.943777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6749-0b46-4b27-8721-a50227e1a3b0 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:41.982865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111960c-1c07-4e7b-aa4c-343934229448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:41.983682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111960c-1c07-4e7b-aa4c-343934229448 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.983985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111960c-1c07-4e7b-aa4c-343934229448 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.984246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111960c-1c07-4e7b-aa4c-343934229448 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.995899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111960c-1c07-4e7b-aa4c-343934229448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-7111960c-1c07-4e7b-aa4c-343934229448 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:42.004392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:42.005297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:42.006128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 59/121] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:42.006812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111960c-1c07-4e7b-aa4c-343934229448 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.013466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 63/122] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:42.014994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fa49-37fe-44ba-8594-052e2bdcd755 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.112726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111960c-1c07-4e7b-aa4c-343934229448 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.127763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fa49-37fe-44ba-8594-052e2bdcd755 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.129737 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:42.149279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.149279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.149279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.149585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.150785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:42.151104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.152501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.161471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 60/123] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:42.162302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.169010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031c2f-e59a-4d7d-88d9-27de9497690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.170134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031c2f-e59a-4d7d-88d9-27de9497690d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.170691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031c2f-e59a-4d7d-88d9-27de9497690d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.171176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031c2f-e59a-4d7d-88d9-27de9497690d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.172044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:42.185638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6031c2f-e59a-4d7d-88d9-27de9497690d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-b6031c2f-e59a-4d7d-88d9-27de9497690d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:42.194936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:42.195820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:42.197028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:42.199367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 64/124] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:42.200594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031c2f-e59a-4d7d-88d9-27de9497690d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.268429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fa22c-9989-46a0-8793-0dc2b8c29fde None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.308676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.309379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.309675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.309960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.310902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:42.311361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.313022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.323809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031c2f-e59a-4d7d-88d9-27de9497690d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.324478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 61/125] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:42.325317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.363523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1940d-5f73-4774-b546-ecae97723975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.364936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1940d-5f73-4774-b546-ecae97723975 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.365475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1940d-5f73-4774-b546-ecae97723975 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.365954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1940d-5f73-4774-b546-ecae97723975 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.367482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1940d-5f73-4774-b546-ecae97723975 None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.369369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1940d-5f73-4774-b546-ecae97723975 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.371454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 65/126] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:42.372676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1940d-5f73-4774-b546-ecae97723975 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.375172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:42.445113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:42.449039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2db32-e6cf-4fe2-bfd9-63ff1a65891c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.492990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219cd1-cae1-4171-8482-92a7196d8690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.493907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219cd1-cae1-4171-8482-92a7196d8690 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.494703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1940d-5f73-4774-b546-ecae97723975 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.498265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219cd1-cae1-4171-8482-92a7196d8690 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.498654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219cd1-cae1-4171-8482-92a7196d8690 None admin] PATH_INFO: `/v3/users/93482eec3eb5456081aa49110195cd04` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.500871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85219cd1-cae1-4171-8482-92a7196d8690 None admin] RBAC: Authorizing `identity:get_user(user_id=93482eec3eb5456081aa49110195cd04)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.502590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85219cd1-cae1-4171-8482-92a7196d8690 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.508804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 62/127] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/users/93482eec3eb5456081aa49110195cd04 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:42.508804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219cd1-cae1-4171-8482-92a7196d8690 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.538656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.539648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.540072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.540486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.541520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:42.541991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.543659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.553165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 66/128] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:42.554328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.645537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219cd1-cae1-4171-8482-92a7196d8690 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.659021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:42.692337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8a44d-d547-4360-a02c-a3812a05b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.693804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a44d-d547-4360-a02c-a3812a05b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.694393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a44d-d547-4360-a02c-a3812a05b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.695440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a44d-d547-4360-a02c-a3812a05b2f5 None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.696802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8a44d-d547-4360-a02c-a3812a05b2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.698535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e639854-7ff3-4855-a224-079292bc2c58 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.699315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8a44d-d547-4360-a02c-a3812a05b2f5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.706936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 63/129] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:42.706936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8a44d-d547-4360-a02c-a3812a05b2f5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.728332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:42.752129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.752825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.753113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.753397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.754306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] RBAC: Adding query filter params (role.id=2213bb7bedd24e0799c92509145673ee, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b, user.id=e1f2ec806588442cba97ea0b8449fd57) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:42.754628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.757653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.765445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 67/130] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/role_assignments?user.id=e1f2ec806588442cba97ea0b8449fd57&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=2213bb7bedd24e0799c92509145673ee => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:42.773379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:42.900477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8a44d-d547-4360-a02c-a3812a05b2f5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.971326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c09f7-93c5-40a5-bfcb-4451ec4fdea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.972160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c09f7-93c5-40a5-bfcb-4451ec4fdea3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.972446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c09f7-93c5-40a5-bfcb-4451ec4fdea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.972722 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c09f7-93c5-40a5-bfcb-4451ec4fdea3 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.973090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e824db-2563-4150-954a-4c64ab033fa4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.976876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c09f7-93c5-40a5-bfcb-4451ec4fdea3 None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.977848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c09f7-93c5-40a5-bfcb-4451ec4fdea3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.980034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 64/131] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:42.980814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c09f7-93c5-40a5-bfcb-4451ec4fdea3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:43.012278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cece654-12cd-402a-99b5-7865de647dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:43.013586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece654-12cd-402a-99b5-7865de647dc8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.014075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece654-12cd-402a-99b5-7865de647dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.014849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece654-12cd-402a-99b5-7865de647dc8 None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.016273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cece654-12cd-402a-99b5-7865de647dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:43.018034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cece654-12cd-402a-99b5-7865de647dc8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:43.019960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 68/132] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:43.020963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cece654-12cd-402a-99b5-7865de647dc8 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:43.084846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:43.106481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:43.136474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cece654-12cd-402a-99b5-7865de647dc8 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:43.174145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a11ed-dbda-48e5-bd04-20a374e4bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:43.175473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a11ed-dbda-48e5-bd04-20a374e4bda2 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.176007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a11ed-dbda-48e5-bd04-20a374e4bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.176489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a11ed-dbda-48e5-bd04-20a374e4bda2 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/users/93482eec3eb5456081aa49110195cd04/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.178786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a11ed-dbda-48e5-bd04-20a374e4bda2 None admin] RBAC: Authorizing `identity:create_grant(project_id=efca54e53d414d1c9c96a76b5d58a31b, user_id=93482eec3eb5456081aa49110195cd04, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:43.180487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a11ed-dbda-48e5-bd04-20a374e4bda2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:43.208445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c09f7-93c5-40a5-bfcb-4451ec4fdea3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:43.247366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df243-e1d5-4d94-abcd-03109b08744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:43.248912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df243-e1d5-4d94-abcd-03109b08744f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.249578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df243-e1d5-4d94-abcd-03109b08744f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.250083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df243-e1d5-4d94-abcd-03109b08744f None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.251594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7df243-e1d5-4d94-abcd-03109b08744f None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:43.253366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7df243-e1d5-4d94-abcd-03109b08744f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:43.255516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 65/133] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:42 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:43.270387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df243-e1d5-4d94-abcd-03109b08744f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:43.297414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 69/134] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:43 2022] PUT /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/users/93482eec3eb5456081aa49110195cd04/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:32:43.298690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a11ed-dbda-48e5-bd04-20a374e4bda2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:43.445848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a11ed-dbda-48e5-bd04-20a374e4bda2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:43.463978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:43.488613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1579b35-3c82-43a7-9bf2-59f19cbb193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:43.489947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1579b35-3c82-43a7-9bf2-59f19cbb193d None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.490638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1579b35-3c82-43a7-9bf2-59f19cbb193d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.491139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1579b35-3c82-43a7-9bf2-59f19cbb193d None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/users/0e178b8fd2ed47c08546f05bd3e7f914/roles/0053c5c9a9f74809be6ecfcdeb35c100` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.493866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1579b35-3c82-43a7-9bf2-59f19cbb193d None admin] RBAC: Authorizing `identity:create_grant(project_id=efca54e53d414d1c9c96a76b5d58a31b, user_id=0e178b8fd2ed47c08546f05bd3e7f914, role_id=0053c5c9a9f74809be6ecfcdeb35c100)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:43.497280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1579b35-3c82-43a7-9bf2-59f19cbb193d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:43.514194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df243-e1d5-4d94-abcd-03109b08744f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:43.528622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:43.550901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf4d87-6fc4-471a-be56-15f31e265eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:43.551819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf4d87-6fc4-471a-be56-15f31e265eb2 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.552114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf4d87-6fc4-471a-be56-15f31e265eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.552398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf4d87-6fc4-471a-be56-15f31e265eb2 None admin] PATH_INFO: `/v3/projects/23fcaf4fbda648d280e68b95ef126e9e` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.553627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf4d87-6fc4-471a-be56-15f31e265eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=23fcaf4fbda648d280e68b95ef126e9e)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:43.555102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf4d87-6fc4-471a-be56-15f31e265eb2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:43.556856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 66/135] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:43 2022] GET /identity/v3/projects/23fcaf4fbda648d280e68b95ef126e9e => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:43.558045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fdae7-fae2-469b-8a84-6cecb2e7f519 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.558364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fdae7-fae2-469b-8a84-6cecb2e7f519 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.558647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fdae7-fae2-469b-8a84-6cecb2e7f519 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.560132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 67/136] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:43.564027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:43 2022] PUT /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/users/0e178b8fd2ed47c08546f05bd3e7f914/roles/0053c5c9a9f74809be6ecfcdeb35c100 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:32:43.565832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fdae7-fae2-469b-8a84-6cecb2e7f519 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:43.567333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b87310-7e92-45ce-9c77-52f7cbbb2a87 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.567838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b87310-7e92-45ce-9c77-52f7cbbb2a87 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.568251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b87310-7e92-45ce-9c77-52f7cbbb2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.604957 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-72b87310-7e92-45ce-9c77-52f7cbbb2a87 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:43.606287 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-72b87310-7e92-45ce-9c77-52f7cbbb2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:43.785161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 71/138] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:43.786886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0195cde-5d6a-49a4-8aaa-2309f4ff2f2a None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.787067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fdae7-fae2-469b-8a84-6cecb2e7f519 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:43.787372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0195cde-5d6a-49a4-8aaa-2309f4ff2f2a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.787865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0195cde-5d6a-49a4-8aaa-2309f4ff2f2a None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.790490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 72/139] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:43.797606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1838-f094-4190-81d6-1e6bdf31fd77 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.797968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1838-f094-4190-81d6-1e6bdf31fd77 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.798343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1838-f094-4190-81d6-1e6bdf31fd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.819037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-130c1838-f094-4190-81d6-1e6bdf31fd77 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:43.820336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-130c1838-f094-4190-81d6-1e6bdf31fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:43.857903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c771-6189-49fe-ac46-0dbb375e37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:43.859142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c771-6189-49fe-ac46-0dbb375e37d0 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:43.859580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c771-6189-49fe-ac46-0dbb375e37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:43.860012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c771-6189-49fe-ac46-0dbb375e37d0 None admin] PATH_INFO: `/v3/projects/23fcaf4fbda648d280e68b95ef126e9e/users/0e178b8fd2ed47c08546f05bd3e7f914/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:43.864002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c771-6189-49fe-ac46-0dbb375e37d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=23fcaf4fbda648d280e68b95ef126e9e, user_id=0e178b8fd2ed47c08546f05bd3e7f914, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:43.865839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c771-6189-49fe-ac46-0dbb375e37d0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:43.910831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 73/140] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:43.911697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1838-f094-4190-81d6-1e6bdf31fd77 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:43.949118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 68/141] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:43 2022] PUT /identity/v3/projects/23fcaf4fbda648d280e68b95ef126e9e/users/0e178b8fd2ed47c08546f05bd3e7f914/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:32:43.965687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:43.991368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c771-6189-49fe-ac46-0dbb375e37d0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:44.039866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1838-f094-4190-81d6-1e6bdf31fd77 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:44.076346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:44.081378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67872877-5b6e-483a-b7f2-7b52f27431d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:44.082249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67872877-5b6e-483a-b7f2-7b52f27431d4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.082537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67872877-5b6e-483a-b7f2-7b52f27431d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.082818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67872877-5b6e-483a-b7f2-7b52f27431d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.084195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67872877-5b6e-483a-b7f2-7b52f27431d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:44.085683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67872877-5b6e-483a-b7f2-7b52f27431d4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:44.087390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 74/142] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:44.096260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67872877-5b6e-483a-b7f2-7b52f27431d4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:44.202154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c771-6189-49fe-ac46-0dbb375e37d0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:44.257281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606729f5-3b33-455f-8bbb-98e67648dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:44.258391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606729f5-3b33-455f-8bbb-98e67648dc89 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.261022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606729f5-3b33-455f-8bbb-98e67648dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.261544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606729f5-3b33-455f-8bbb-98e67648dc89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.285074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606729f5-3b33-455f-8bbb-98e67648dc89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-606729f5-3b33-455f-8bbb-98e67648dc89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:44.301639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:44.302828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:44.303812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:44.307777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 69/143] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:32:44.314655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606729f5-3b33-455f-8bbb-98e67648dc89 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:44.335699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67872877-5b6e-483a-b7f2-7b52f27431d4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:44.339345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:44.411190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977a20d-3aa3-469f-9e8d-93ad67d20346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:44.412709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977a20d-3aa3-469f-9e8d-93ad67d20346 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.413032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977a20d-3aa3-469f-9e8d-93ad67d20346 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.413319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977a20d-3aa3-469f-9e8d-93ad67d20346 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.414068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977a20d-3aa3-469f-9e8d-93ad67d20346 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:44.415561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977a20d-3aa3-469f-9e8d-93ad67d20346 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:44.505288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606729f5-3b33-455f-8bbb-98e67648dc89 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:44.518646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:44.558979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 75/144] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:32:44 2022] POST /identity/v3/users => generated 283 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:44.562986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55636e37-141e-494f-aba9-737352914786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:44.563699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55636e37-141e-494f-aba9-737352914786 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.563981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55636e37-141e-494f-aba9-737352914786 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.564257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55636e37-141e-494f-aba9-737352914786 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.565015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55636e37-141e-494f-aba9-737352914786 None admin] RBAC: Adding query filter params (name=member) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:44.565321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55636e37-141e-494f-aba9-737352914786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:44.566756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55636e37-141e-494f-aba9-737352914786 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:44.582510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 70/145] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:44.588210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977a20d-3aa3-469f-9e8d-93ad67d20346 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:44.729077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977a20d-3aa3-469f-9e8d-93ad67d20346 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:44.787660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51160604-1f4c-46f4-9a48-eab521250c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:44.788569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160604-1f4c-46f4-9a48-eab521250c87 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.789106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160604-1f4c-46f4-9a48-eab521250c87 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.789388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160604-1f4c-46f4-9a48-eab521250c87 None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.791325 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51160604-1f4c-46f4-9a48-eab521250c87 None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:44.793037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51160604-1f4c-46f4-9a48-eab521250c87 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:44.796482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 76/146] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:44 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:44.801150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55636e37-141e-494f-aba9-737352914786 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:44.958923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55636e37-141e-494f-aba9-737352914786 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:45.010562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303d1ce-e0dc-48f9-82ce-753217d8d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:45.011234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303d1ce-e0dc-48f9-82ce-753217d8d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:45.011569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303d1ce-e0dc-48f9-82ce-753217d8d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:45.011855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303d1ce-e0dc-48f9-82ce-753217d8d7a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:45.058853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:45.115349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303d1ce-e0dc-48f9-82ce-753217d8d7a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:45.116849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303d1ce-e0dc-48f9-82ce-753217d8d7a9 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:45.232494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 71/147] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:45.240550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51160604-1f4c-46f4-9a48-eab521250c87 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:45.284518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:45.376905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51160604-1f4c-46f4-9a48-eab521250c87 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:45.414793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3831930-d709-4926-901c-6d8e2238a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:45.416334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831930-d709-4926-901c-6d8e2238a38d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:45.416839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831930-d709-4926-901c-6d8e2238a38d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:45.417316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831930-d709-4926-901c-6d8e2238a38d None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:45.419043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3831930-d709-4926-901c-6d8e2238a38d None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:45.420973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3831930-d709-4926-901c-6d8e2238a38d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:45.423897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 77/148] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:45 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:45.429292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303d1ce-e0dc-48f9-82ce-753217d8d7a9 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:45.518880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:45.554248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303d1ce-e0dc-48f9-82ce-753217d8d7a9 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:45.596027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d051efa-0f9e-4db3-90ad-abd52d7a3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:45.596694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d051efa-0f9e-4db3-90ad-abd52d7a3974 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:45.596981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d051efa-0f9e-4db3-90ad-abd52d7a3974 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:45.597254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d051efa-0f9e-4db3-90ad-abd52d7a3974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:45.598117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d051efa-0f9e-4db3-90ad-abd52d7a3974 None admin] RBAC: Adding query filter params (role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b, user.id=0e178b8fd2ed47c08546f05bd3e7f914) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:45.598439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d051efa-0f9e-4db3-90ad-abd52d7a3974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:45.599909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d051efa-0f9e-4db3-90ad-abd52d7a3974 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:45.607145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 72/149] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:45 2022] GET /identity/v3/role_assignments?user.id=0e178b8fd2ed47c08546f05bd3e7f914&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:45.997095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b290-ff83-4b30-a499-9f1a199c4438 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:45.997453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b290-ff83-4b30-a499-9f1a199c4438 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:45.997655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b290-ff83-4b30-a499-9f1a199c4438 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:45.999066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 78/150] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:46.004416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9986-7d6b-4b10-bcf8-31348c2810a1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:46.004706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9986-7d6b-4b10-bcf8-31348c2810a1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:46.004995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9986-7d6b-4b10-bcf8-31348c2810a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:46.030541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-de7b9986-7d6b-4b10-bcf8-31348c2810a1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:46.031738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-de7b9986-7d6b-4b10-bcf8-31348c2810a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:46.124123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 73/151] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:46.165966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883b290-ff83-4b30-a499-9f1a199c4438 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:46.281612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:46.284304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32e79-c06d-474a-82d1-bcb5974c3318 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:46.284728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32e79-c06d-474a-82d1-bcb5974c3318 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:46.284924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32e79-c06d-474a-82d1-bcb5974c3318 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:46.286715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 74/152] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:46.293170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0c53-e714-4921-afa2-a103c6007787 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:46.293455 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0c53-e714-4921-afa2-a103c6007787 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:46.293732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0c53-e714-4921-afa2-a103c6007787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:46.294368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883b290-ff83-4b30-a499-9f1a199c4438 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:46.313592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-505c0c53-e714-4921-afa2-a103c6007787 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:46.314968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-505c0c53-e714-4921-afa2-a103c6007787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:46.366816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71732238-a6a3-44d6-9c05-148bf8036cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:46.368014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71732238-a6a3-44d6-9c05-148bf8036cab None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:46.368512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71732238-a6a3-44d6-9c05-148bf8036cab None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:46.369083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71732238-a6a3-44d6-9c05-148bf8036cab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:46.394512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:46.398496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 75/153] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:46.400650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288793fc-a4ec-42a8-979c-2907ed527a95 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:46.400650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288793fc-a4ec-42a8-979c-2907ed527a95 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:46.401059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288793fc-a4ec-42a8-979c-2907ed527a95 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:46.403895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 76/154] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:46.405559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71732238-a6a3-44d6-9c05-148bf8036cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:46.407816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc8734-3660-4278-99f3-031dac936da1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:46.408102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc8734-3660-4278-99f3-031dac936da1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:46.408381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc8734-3660-4278-99f3-031dac936da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-71732238-a6a3-44d6-9c05-148bf8036cab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:46.420326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:46.424232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:46.425020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 79/155] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:46.429395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71732238-a6a3-44d6-9c05-148bf8036cab None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:46.436493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7efc8734-3660-4278-99f3-031dac936da1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:46.438605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7efc8734-3660-4278-99f3-031dac936da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:46.536212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 77/156] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:46.537102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc8734-3660-4278-99f3-031dac936da1 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:46.665276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71732238-a6a3-44d6-9c05-148bf8036cab None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:46.717235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc8734-3660-4278-99f3-031dac936da1 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:46.732939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:46.733942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:46.734474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:46.735037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:46.736057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:46.736627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:46.747520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:46.770448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:46.770632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 80/157] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:46.771470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:46.818148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed3f47-b703-49fa-b91b-6836ebd39d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:46.818836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3f47-b703-49fa-b91b-6836ebd39d02 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:46.819119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3f47-b703-49fa-b91b-6836ebd39d02 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:46.819395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3f47-b703-49fa-b91b-6836ebd39d02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:46.827872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:46.854012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed3f47-b703-49fa-b91b-6836ebd39d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-53ed3f47-b703-49fa-b91b-6836ebd39d02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:46.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:46.875086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:46.875871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 78/158] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:32:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:46.876525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed3f47-b703-49fa-b91b-6836ebd39d02 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.028082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5ac2-77eb-4c65-9ad3-67742b74a03c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.079018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed3f47-b703-49fa-b91b-6836ebd39d02 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.116307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc384-c345-4aac-b105-171a64dbeab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.117637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc384-c345-4aac-b105-171a64dbeab2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.118145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc384-c345-4aac-b105-171a64dbeab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.118661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc384-c345-4aac-b105-171a64dbeab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.151178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fc384-c345-4aac-b105-171a64dbeab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-4f0fc384-c345-4aac-b105-171a64dbeab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:47.159582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:47.160527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:47.161367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:47.162801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19264c-3c51-486a-9160-df8c285cc22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.163701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19264c-3c51-486a-9160-df8c285cc22d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.163987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19264c-3c51-486a-9160-df8c285cc22d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.164265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19264c-3c51-486a-9160-df8c285cc22d None admin] PATH_INFO: `/v3/users/e1f2ec806588442cba97ea0b8449fd57` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.164909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 81/159] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:47.166082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19264c-3c51-486a-9160-df8c285cc22d None admin] RBAC: Authorizing `identity:get_user(user_id=e1f2ec806588442cba97ea0b8449fd57)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:47.169517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19264c-3c51-486a-9160-df8c285cc22d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:47.169517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 79/160] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:46 2022] GET /identity/v3/users/e1f2ec806588442cba97ea0b8449fd57 => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:47.170287 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc384-c345-4aac-b105-171a64dbeab2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.180240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19264c-3c51-486a-9160-df8c285cc22d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.266062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:47.293677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:47.334526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc384-c345-4aac-b105-171a64dbeab2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.373225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19264c-3c51-486a-9160-df8c285cc22d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.398932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.401373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.402052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.406792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.406792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:47.406792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:47.406792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:47.422306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 82/161] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:32:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:47.424068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.442435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3b064-b2a9-40c9-81f8-2f91061eab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.443850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b064-b2a9-40c9-81f8-2f91061eab86 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.444353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b064-b2a9-40c9-81f8-2f91061eab86 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.444817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b064-b2a9-40c9-81f8-2f91061eab86 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.446359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3b064-b2a9-40c9-81f8-2f91061eab86 None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:47.448064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3b064-b2a9-40c9-81f8-2f91061eab86 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:47.450012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 80/162] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:47 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:47.450984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3b064-b2a9-40c9-81f8-2f91061eab86 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.635496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3b064-b2a9-40c9-81f8-2f91061eab86 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.651899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91f623-8a56-4071-bb94-c3e98b7c58f4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.668344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:47.707539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a17f1-52fa-4fed-b6a3-e1e72d8c0995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.709566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a17f1-52fa-4fed-b6a3-e1e72d8c0995 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.711626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a17f1-52fa-4fed-b6a3-e1e72d8c0995 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.712464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a17f1-52fa-4fed-b6a3-e1e72d8c0995 None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.714733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a17f1-52fa-4fed-b6a3-e1e72d8c0995 None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:47.716829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a17f1-52fa-4fed-b6a3-e1e72d8c0995 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:47.718978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d52edf-c66f-4ea7-b04e-4ce70c13a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.720115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52edf-c66f-4ea7-b04e-4ce70c13a70a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.721787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:47 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:47.722302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52edf-c66f-4ea7-b04e-4ce70c13a70a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.722790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52edf-c66f-4ea7-b04e-4ce70c13a70a None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.723736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d52edf-c66f-4ea7-b04e-4ce70c13a70a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:47.724669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a17f1-52fa-4fed-b6a3-e1e72d8c0995 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.725182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d52edf-c66f-4ea7-b04e-4ce70c13a70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:47.727274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d52edf-c66f-4ea7-b04e-4ce70c13a70a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:47.742357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:47.758146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:47.758146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd25d7-881b-476f-8ce4-0bde3ff9c8a8 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.758146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd25d7-881b-476f-8ce4-0bde3ff9c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.758146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd25d7-881b-476f-8ce4-0bde3ff9c8a8 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.758146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 84/165] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:47.758146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd25d7-881b-476f-8ce4-0bde3ff9c8a8 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.940058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a17f1-52fa-4fed-b6a3-e1e72d8c0995 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.959775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd25d7-881b-476f-8ce4-0bde3ff9c8a8 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.996588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1c9bd-b6fc-4cd4-b4c3-9a57801373a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.997295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1c9bd-b6fc-4cd4-b4c3-9a57801373a9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.997580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1c9bd-b6fc-4cd4-b4c3-9a57801373a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.997858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1c9bd-b6fc-4cd4-b4c3-9a57801373a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.031376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1b7f9-bbb7-47ed-8329-e9aeb4ed0950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:48.032628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b7f9-bbb7-47ed-8329-e9aeb4ed0950 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.033299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b7f9-bbb7-47ed-8329-e9aeb4ed0950 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.033794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b7f9-bbb7-47ed-8329-e9aeb4ed0950 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/users/e1f2ec806588442cba97ea0b8449fd57/roles/2213bb7bedd24e0799c92509145673ee` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.036074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1b7f9-bbb7-47ed-8329-e9aeb4ed0950 None admin] RBAC: Authorizing `identity:create_grant(project_id=efca54e53d414d1c9c96a76b5d58a31b, user_id=e1f2ec806588442cba97ea0b8449fd57, role_id=2213bb7bedd24e0799c92509145673ee)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:48.037767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1b7f9-bbb7-47ed-8329-e9aeb4ed0950 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:48.071361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1c9bd-b6fc-4cd4-b4c3-9a57801373a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:48.072869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1c9bd-b6fc-4cd4-b4c3-9a57801373a9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:48.086529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:48.180172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 85/166] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:48.180905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1c9bd-b6fc-4cd4-b4c3-9a57801373a9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:48.183667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 82/167] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:47 2022] PUT /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/users/e1f2ec806588442cba97ea0b8449fd57/roles/2213bb7bedd24e0799c92509145673ee => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:32:48.185171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e491cfe-2ba5-4679-b4db-3e7cf98403a6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.185866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e491cfe-2ba5-4679-b4db-3e7cf98403a6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.189092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e491cfe-2ba5-4679-b4db-3e7cf98403a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.206246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9e491cfe-2ba5-4679-b4db-3e7cf98403a6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:48.207361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9e491cfe-2ba5-4679-b4db-3e7cf98403a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:48.245364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:48.290360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 83/168] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:48.292015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e491cfe-2ba5-4679-b4db-3e7cf98403a6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:48.372412 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:48.381965 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1c9bd-b6fc-4cd4-b4c3-9a57801373a9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:48.466924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e1cef-d6aa-42b0-92d3-6b4c2713149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:48.467745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1cef-d6aa-42b0-92d3-6b4c2713149e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.468030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1cef-d6aa-42b0-92d3-6b4c2713149e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.468307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1cef-d6aa-42b0-92d3-6b4c2713149e None admin] PATH_INFO: `/v3/users/93482eec3eb5456081aa49110195cd04` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.473123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1cef-d6aa-42b0-92d3-6b4c2713149e None admin] RBAC: Authorizing `identity:get_user(user_id=93482eec3eb5456081aa49110195cd04)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:48.474886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1cef-d6aa-42b0-92d3-6b4c2713149e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:48.476836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 86/169] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:48 2022] GET /identity/v3/users/93482eec3eb5456081aa49110195cd04 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:48.478578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda16d2-554b-482f-8918-bb5af50274d1 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.479169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda16d2-554b-482f-8918-bb5af50274d1 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.479649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda16d2-554b-482f-8918-bb5af50274d1 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.481124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 87/170] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:48.481599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e491cfe-2ba5-4679-b4db-3e7cf98403a6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:48.482800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda16d2-554b-482f-8918-bb5af50274d1 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:48.549303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb118017-9dea-46f1-9585-79a441fda89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:48.552570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118017-9dea-46f1-9585-79a441fda89a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.553097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118017-9dea-46f1-9585-79a441fda89a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.553576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118017-9dea-46f1-9585-79a441fda89a None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.555876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb118017-9dea-46f1-9585-79a441fda89a None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:48.558866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb118017-9dea-46f1-9585-79a441fda89a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:48.562142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 84/171] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:48 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:48.563204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb118017-9dea-46f1-9585-79a441fda89a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:48.621385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:48.629954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda16d2-554b-482f-8918-bb5af50274d1 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:48.675626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b29477-7d2e-4a93-a3bc-2dbe41d8dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:48.676729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b29477-7d2e-4a93-a3bc-2dbe41d8dd80 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.677017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b29477-7d2e-4a93-a3bc-2dbe41d8dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.677300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b29477-7d2e-4a93-a3bc-2dbe41d8dd80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.691860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b29477-7d2e-4a93-a3bc-2dbe41d8dd80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:48.693670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb118017-9dea-46f1-9585-79a441fda89a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-c8b29477-7d2e-4a93-a3bc-2dbe41d8dd80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:48.701213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:48.702167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:48.703009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 88/172] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:48.707076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3927-779f-4b7b-a9af-5ad84f6d9b0f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.707076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3927-779f-4b7b-a9af-5ad84f6d9b0f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.707076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3927-779f-4b7b-a9af-5ad84f6d9b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.726262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-47bc3927-779f-4b7b-a9af-5ad84f6d9b0f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:48.727865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-47bc3927-779f-4b7b-a9af-5ad84f6d9b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:48.733380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302696e3-c3db-4104-92d8-6a249f23889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:48.734183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302696e3-c3db-4104-92d8-6a249f23889a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.734534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302696e3-c3db-4104-92d8-6a249f23889a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.734873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302696e3-c3db-4104-92d8-6a249f23889a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.759107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:48.816685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 89/173] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:48.817810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3927-779f-4b7b-a9af-5ad84f6d9b0f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:48.840475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302696e3-c3db-4104-92d8-6a249f23889a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:48.842215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302696e3-c3db-4104-92d8-6a249f23889a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:48.893275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:48.953659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3927-779f-4b7b-a9af-5ad84f6d9b0f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:48.958091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 85/174] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:48.959498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5595fd3-b54a-430d-a411-fa33c9a1fd0c None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.959850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5595fd3-b54a-430d-a411-fa33c9a1fd0c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.960185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5595fd3-b54a-430d-a411-fa33c9a1fd0c None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.961542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 86/175] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:48.966331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5595fd3-b54a-430d-a411-fa33c9a1fd0c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:48.991554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:48.992142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.992432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.992716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.993558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] RBAC: Adding query filter params (role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b, user.id=0e178b8fd2ed47c08546f05bd3e7f914) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:48.994445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:48.995904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:49.001933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 90/176] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:48 2022] GET /identity/v3/role_assignments?user.id=0e178b8fd2ed47c08546f05bd3e7f914&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:49.002811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.037086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.103714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5595fd3-b54a-430d-a411-fa33c9a1fd0c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.148646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597cc40-e8de-4e9f-bb95-943e618cedfa None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.150084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a49bdc-9126-42f0-8ce4-34d20d6972e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.151181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49bdc-9126-42f0-8ce4-34d20d6972e3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.151489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49bdc-9126-42f0-8ce4-34d20d6972e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.151772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49bdc-9126-42f0-8ce4-34d20d6972e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.153452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49bdc-9126-42f0-8ce4-34d20d6972e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:49.153778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49bdc-9126-42f0-8ce4-34d20d6972e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:49.155247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49bdc-9126-42f0-8ce4-34d20d6972e3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:49.161601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.168876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 87/177] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:49.170328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75085-ddb4-4b89-abaa-7a8ce598e78e None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.170678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75085-ddb4-4b89-abaa-7a8ce598e78e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.171522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75085-ddb4-4b89-abaa-7a8ce598e78e None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.177920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 88/178] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:49.177920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f75085-ddb4-4b89-abaa-7a8ce598e78e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.199263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d42c2-34f8-4778-8013-533a63557ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.200396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d42c2-34f8-4778-8013-533a63557ca7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.200849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d42c2-34f8-4778-8013-533a63557ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.201308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d42c2-34f8-4778-8013-533a63557ca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.212657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d42c2-34f8-4778-8013-533a63557ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-a80d42c2-34f8-4778-8013-533a63557ca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:49.220888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:49.221783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:49.222825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:49.225069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 91/179] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:49.226566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905468d0-d321-4407-835d-56218bad2e45 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.227065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905468d0-d321-4407-835d-56218bad2e45 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.227587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905468d0-d321-4407-835d-56218bad2e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.246721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-905468d0-d321-4407-835d-56218bad2e45 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:49.247708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-905468d0-d321-4407-835d-56218bad2e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:49.304808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f75085-ddb4-4b89-abaa-7a8ce598e78e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.322912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 92/180] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:49.331474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d476-6706-4c27-94be-6f260f453bcc None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.331773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d476-6706-4c27-94be-6f260f453bcc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.332056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d476-6706-4c27-94be-6f260f453bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.345111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974ca54-1185-4700-9496-cdabcfb9f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.346982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974ca54-1185-4700-9496-cdabcfb9f09e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.347564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974ca54-1185-4700-9496-cdabcfb9f09e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.348049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974ca54-1185-4700-9496-cdabcfb9f09e None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.349703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974ca54-1185-4700-9496-cdabcfb9f09e None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:49.351616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974ca54-1185-4700-9496-cdabcfb9f09e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:49.352183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f118d476-6706-4c27-94be-6f260f453bcc None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:49.353915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f118d476-6706-4c27-94be-6f260f453bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:49.354730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 89/181] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:49.355656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974ca54-1185-4700-9496-cdabcfb9f09e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.362592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.428747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 93/182] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:49.429406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d476-6706-4c27-94be-6f260f453bcc None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.448055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.487774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974ca54-1185-4700-9496-cdabcfb9f09e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.525986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4e8a-4199-42ca-936f-a56f30501061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.526811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4e8a-4199-42ca-936f-a56f30501061 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.527098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4e8a-4199-42ca-936f-a56f30501061 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.527368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4e8a-4199-42ca-936f-a56f30501061 None admin] PATH_INFO: `/v3/users/0e178b8fd2ed47c08546f05bd3e7f914` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.528700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4e8a-4199-42ca-936f-a56f30501061 None admin] RBAC: Authorizing `identity:get_user(user_id=0e178b8fd2ed47c08546f05bd3e7f914)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:49.530058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4e8a-4199-42ca-936f-a56f30501061 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:49.531750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 90/183] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/users/0e178b8fd2ed47c08546f05bd3e7f914 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:49.535504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4e8a-4199-42ca-936f-a56f30501061 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.548317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d476-6706-4c27-94be-6f260f453bcc None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.584218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.584588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.584875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.585154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.585913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:49.586257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:49.588177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:49.596484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 94/184] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:49.596484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.602401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.659954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4e8a-4199-42ca-936f-a56f30501061 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.695084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de613a9-1a3e-4809-a70c-3f0e18282dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.696127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de613a9-1a3e-4809-a70c-3f0e18282dd9 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.696703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de613a9-1a3e-4809-a70c-3f0e18282dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.697151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de613a9-1a3e-4809-a70c-3f0e18282dd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.698558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de613a9-1a3e-4809-a70c-3f0e18282dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:49.700381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de613a9-1a3e-4809-a70c-3f0e18282dd9 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:49.702326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 91/185] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:49.703236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de613a9-1a3e-4809-a70c-3f0e18282dd9 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.707655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.711157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8300d-ab4a-4965-91a6-c20649f19460 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.751057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.751773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.752158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.752516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.753607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b, user.id=93482eec3eb5456081aa49110195cd04) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:49.753765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:49.755230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:49.762289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 95/186] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/role_assignments?user.id=93482eec3eb5456081aa49110195cd04&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:49.763157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.831196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de613a9-1a3e-4809-a70c-3f0e18282dd9 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.842590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.872888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41df5-9907-4e74-9e8d-81f331653bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.874220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41df5-9907-4e74-9e8d-81f331653bd1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.874715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41df5-9907-4e74-9e8d-81f331653bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.875203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41df5-9907-4e74-9e8d-81f331653bd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.883314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f12fed-39b0-4f2c-9d5b-559296b6eddd None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.889631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff41df5-9907-4e74-9e8d-81f331653bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-0ff41df5-9907-4e74-9e8d-81f331653bd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:49.899242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:49.900876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:49.901685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:49.904572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 92/187] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:49.905761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41df5-9907-4e74-9e8d-81f331653bd1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.934699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b0f6-3a97-4437-9817-8e7ad3d7bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.935428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b0f6-3a97-4437-9817-8e7ad3d7bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.935719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b0f6-3a97-4437-9817-8e7ad3d7bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.936002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b0f6-3a97-4437-9817-8e7ad3d7bdd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.989055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.024756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501b0f6-3a97-4437-9817-8e7ad3d7bdd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.026848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501b0f6-3a97-4437-9817-8e7ad3d7bdd5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.063870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41df5-9907-4e74-9e8d-81f331653bd1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.107056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15a3ec-c9dc-4d1f-9acb-2e5348a1c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:50.107946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15a3ec-c9dc-4d1f-9acb-2e5348a1c8df None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.108289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15a3ec-c9dc-4d1f-9acb-2e5348a1c8df None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.108584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15a3ec-c9dc-4d1f-9acb-2e5348a1c8df None admin] PATH_INFO: `/v3/users/db2f9192fa8a45cc9b77fc83df6874e3` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.119455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.123289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15a3ec-c9dc-4d1f-9acb-2e5348a1c8df None admin] RBAC: Authorizing `identity:get_user(user_id=db2f9192fa8a45cc9b77fc83df6874e3)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.124846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15a3ec-c9dc-4d1f-9acb-2e5348a1c8df None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.131120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 93/188] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/users/db2f9192fa8a45cc9b77fc83df6874e3 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:50.131120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15a3ec-c9dc-4d1f-9acb-2e5348a1c8df None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:50.164704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 96/189] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:50.164704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b0f6-3a97-4437-9817-8e7ad3d7bdd5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:50.245738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15a3ec-c9dc-4d1f-9acb-2e5348a1c8df None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.268586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b0f6-3a97-4437-9817-8e7ad3d7bdd5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.272791 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.283963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a030-6e7e-4dad-9620-d6561c247f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:50.284644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a030-6e7e-4dad-9620-d6561c247f3f None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.284933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a030-6e7e-4dad-9620-d6561c247f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.285217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a030-6e7e-4dad-9620-d6561c247f3f None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.285935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a030-6e7e-4dad-9620-d6561c247f3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.287431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a030-6e7e-4dad-9620-d6561c247f3f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.305979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:50.307218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.307504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.307780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.308534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:50.308840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.310247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.318541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 97/190] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:32:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:50.324150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:50.352866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.397965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 94/191] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:32:50 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:50.399119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a030-6e7e-4dad-9620-d6561c247f3f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:50.436601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ce80b-8d26-4186-91d3-299de7ed5bf2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.477871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fdc09-0d0f-4f3e-87b2-717af99e8393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:50.478639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fdc09-0d0f-4f3e-87b2-717af99e8393 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.478930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fdc09-0d0f-4f3e-87b2-717af99e8393 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.479335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fdc09-0d0f-4f3e-87b2-717af99e8393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.518327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a030-6e7e-4dad-9620-d6561c247f3f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.555727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4226c6-c607-45b0-b358-cbd9c1cff703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:50.557166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4226c6-c607-45b0-b358-cbd9c1cff703 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.557452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4226c6-c607-45b0-b358-cbd9c1cff703 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.557729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4226c6-c607-45b0-b358-cbd9c1cff703 None admin] PATH_INFO: `/v3/projects/23fcaf4fbda648d280e68b95ef126e9e` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.559040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4226c6-c607-45b0-b358-cbd9c1cff703 None admin] RBAC: Authorizing `identity:get_project(project_id=23fcaf4fbda648d280e68b95ef126e9e)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.560362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fdc09-0d0f-4f3e-87b2-717af99e8393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.560607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4226c6-c607-45b0-b358-cbd9c1cff703 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.561834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fdc09-0d0f-4f3e-87b2-717af99e8393 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.562612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 95/192] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:50 2022] GET /identity/v3/projects/23fcaf4fbda648d280e68b95ef126e9e => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:50.563169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4226c6-c607-45b0-b358-cbd9c1cff703 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:50.595978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.621004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.687065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 98/193] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:50.687241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4226c6-c607-45b0-b358-cbd9c1cff703 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.689070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0213d-8f67-4baa-a0b6-d5c04128fa05 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.689361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0213d-8f67-4baa-a0b6-d5c04128fa05 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.689641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0213d-8f67-4baa-a0b6-d5c04128fa05 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.691964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 99/194] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:50.692759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0213d-8f67-4baa-a0b6-d5c04128fa05 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:50.737905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc0ddc-b431-4080-9ad7-01b75a87f21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:50.738984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0ddc-b431-4080-9ad7-01b75a87f21e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.739252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0ddc-b431-4080-9ad7-01b75a87f21e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.739529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0ddc-b431-4080-9ad7-01b75a87f21e None admin] PATH_INFO: `/v3/users/db2f9192fa8a45cc9b77fc83df6874e3` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.740777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc0ddc-b431-4080-9ad7-01b75a87f21e None admin] RBAC: Authorizing `identity:get_user(user_id=db2f9192fa8a45cc9b77fc83df6874e3)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.742294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc0ddc-b431-4080-9ad7-01b75a87f21e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.744630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 96/195] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:50 2022] GET /identity/v3/users/db2f9192fa8a45cc9b77fc83df6874e3 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:50.745485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc0ddc-b431-4080-9ad7-01b75a87f21e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:50.835707 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0213d-8f67-4baa-a0b6-d5c04128fa05 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.866064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc0ddc-b431-4080-9ad7-01b75a87f21e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.867096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.874031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e478086-2e6b-40d4-a422-73c5ba206f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:50.884808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478086-2e6b-40d4-a422-73c5ba206f1f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.884808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478086-2e6b-40d4-a422-73c5ba206f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.884808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478086-2e6b-40d4-a422-73c5ba206f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.884808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e478086-2e6b-40d4-a422-73c5ba206f1f None admin] RBAC: Adding query filter params (role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=23fcaf4fbda648d280e68b95ef126e9e, user.id=0e178b8fd2ed47c08546f05bd3e7f914) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:50.884808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e478086-2e6b-40d4-a422-73c5ba206f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.884808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e478086-2e6b-40d4-a422-73c5ba206f1f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.885275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.885359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 100/196] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:50 2022] GET /identity/v3/role_assignments?user.id=0e178b8fd2ed47c08546f05bd3e7f914&scope.project.id=23fcaf4fbda648d280e68b95ef126e9e&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:50.886332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ab4ab-84fb-4563-8a42-06b4bdcb0af4 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.886631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ab4ab-84fb-4563-8a42-06b4bdcb0af4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.886916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ab4ab-84fb-4563-8a42-06b4bdcb0af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.905701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-173ab4ab-84fb-4563-8a42-06b4bdcb0af4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:50.907609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-173ab4ab-84fb-4563-8a42-06b4bdcb0af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:50.933906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b4e67-eb89-47d9-8d95-16e03aeece65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:50.936374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b4e67-eb89-47d9-8d95-16e03aeece65 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.936374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b4e67-eb89-47d9-8d95-16e03aeece65 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.936374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b4e67-eb89-47d9-8d95-16e03aeece65 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.941540 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b4e67-eb89-47d9-8d95-16e03aeece65 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:50.943024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b4e67-eb89-47d9-8d95-16e03aeece65 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:50.944968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 97/197] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:50 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:50.945837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b4e67-eb89-47d9-8d95-16e03aeece65 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:51.039234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 101/198] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:51.040108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ab4ab-84fb-4563-8a42-06b4bdcb0af4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:51.143513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b4e67-eb89-47d9-8d95-16e03aeece65 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:51.176952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ab4ab-84fb-4563-8a42-06b4bdcb0af4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:51.179952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091db78-a955-4975-9e26-645e548393e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:51.180610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091db78-a955-4975-9e26-645e548393e7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:51.180894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091db78-a955-4975-9e26-645e548393e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:51.181199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091db78-a955-4975-9e26-645e548393e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:51.202854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:51.234028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:51.235105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:51.235604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:51.236090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:51.237129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874, user.id=db2f9192fa8a45cc9b77fc83df6874e3) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:51.237654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:51.239712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:51.249585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 102/199] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:51 2022] GET /identity/v3/role_assignments?user.id=db2f9192fa8a45cc9b77fc83df6874e3&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:51.251262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:51.264623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:51.313754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091db78-a955-4975-9e26-645e548393e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:51.315427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091db78-a955-4975-9e26-645e548393e7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:51.383596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d89d-3f3d-40cc-b967-f040fd782f88 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:51.426969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2231065-c569-4017-8ed5-7e9abb404226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:51.428166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231065-c569-4017-8ed5-7e9abb404226 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:51.428987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231065-c569-4017-8ed5-7e9abb404226 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:51.429489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231065-c569-4017-8ed5-7e9abb404226 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:51.443184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2231065-c569-4017-8ed5-7e9abb404226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-f2231065-c569-4017-8ed5-7e9abb404226 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:51.453236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:51.454208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:32:51.455040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:51.457818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 103/200] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:51.467661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2231065-c569-4017-8ed5-7e9abb404226 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:51.542574 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:51.558661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 98/201] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:51.564661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091db78-a955-4975-9e26-645e548393e7 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:51.599886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2231065-c569-4017-8ed5-7e9abb404226 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:51.661572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:51.662281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:51.662568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:51.662851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:51.663616 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:51.664092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:51.665518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:51.683166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 104/202] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:51.687209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:51.712800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:51.752153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091db78-a955-4975-9e26-645e548393e7 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:51.809845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbbd5a-ce13-46bf-8c80-24212f3607e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:51.810752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbbd5a-ce13-46bf-8c80-24212f3607e9 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:51.811038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbbd5a-ce13-46bf-8c80-24212f3607e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:51.811315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbbd5a-ce13-46bf-8c80-24212f3607e9 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:51.812538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbbd5a-ce13-46bf-8c80-24212f3607e9 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:51.813983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbbd5a-ce13-46bf-8c80-24212f3607e9 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:51.815810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 99/203] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:51 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:51.824459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbbd5a-ce13-46bf-8c80-24212f3607e9 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:51.896230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccf3ff-a15b-4afa-b57a-0f76f4485a50 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:51.910511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:51.938572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b63a-0906-4947-bc63-249db167656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:51.939497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b63a-0906-4947-bc63-249db167656a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:51.939790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b63a-0906-4947-bc63-249db167656a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:51.940065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b63a-0906-4947-bc63-249db167656a None admin] PATH_INFO: `/v3/users/e1f2ec806588442cba97ea0b8449fd57` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:51.941013 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbbd5a-ce13-46bf-8c80-24212f3607e9 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:51.941374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b63a-0906-4947-bc63-249db167656a None admin] RBAC: Authorizing `identity:get_user(user_id=e1f2ec806588442cba97ea0b8449fd57)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:51.947519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b63a-0906-4947-bc63-249db167656a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:51.949435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:51 2022] GET /identity/v3/users/e1f2ec806588442cba97ea0b8449fd57 => generated 289 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:51.954898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b63a-0906-4947-bc63-249db167656a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:51.999458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:52.000030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:52.000319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:52.000596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:52.001433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] RBAC: Adding query filter params (role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874, user.id=db2f9192fa8a45cc9b77fc83df6874e3) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:52.001750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:52.003239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:52.012252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 100/205] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:51 2022] GET /identity/v3/role_assignments?user.id=db2f9192fa8a45cc9b77fc83df6874e3&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:52.126444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b63a-0906-4947-bc63-249db167656a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:52.205631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925edc8-b14c-4775-b14a-5ff781d0496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:52.207222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925edc8-b14c-4775-b14a-5ff781d0496d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:52.207985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925edc8-b14c-4775-b14a-5ff781d0496d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:52.208741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925edc8-b14c-4775-b14a-5ff781d0496d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:52.306876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:52.345042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925edc8-b14c-4775-b14a-5ff781d0496d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:52.348463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925edc8-b14c-4775-b14a-5ff781d0496d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:52.522135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 106/206] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:32:52.529822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:52.555556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:52.712403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0eb57-fb48-4b9d-af27-16640a50717e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:52.791358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecee2b-b923-44e7-a863-7e730cfee66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:52.792840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecee2b-b923-44e7-a863-7e730cfee66d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:52.793325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecee2b-b923-44e7-a863-7e730cfee66d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:52.793807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecee2b-b923-44e7-a863-7e730cfee66d None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:52.795844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecee2b-b923-44e7-a863-7e730cfee66d None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:52.798513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecee2b-b923-44e7-a863-7e730cfee66d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:52.802061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 101/207] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:52 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:52.815368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925edc8-b14c-4775-b14a-5ff781d0496d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:52.922399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:52.946548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925edc8-b14c-4775-b14a-5ff781d0496d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:52.994425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2f312-6f94-47a4-83d3-f85e3791c966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:52.995012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f312-6f94-47a4-83d3-f85e3791c966 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:52.995298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f312-6f94-47a4-83d3-f85e3791c966 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:52.995574 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f312-6f94-47a4-83d3-f85e3791c966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:52.996415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2f312-6f94-47a4-83d3-f85e3791c966 None admin] RBAC: Adding query filter params (role.id=2213bb7bedd24e0799c92509145673ee, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b, user.id=e1f2ec806588442cba97ea0b8449fd57) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:52.996725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2f312-6f94-47a4-83d3-f85e3791c966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:52.998206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2f312-6f94-47a4-83d3-f85e3791c966 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:53.004846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 107/208] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:52 2022] GET /identity/v3/role_assignments?user.id=e1f2ec806588442cba97ea0b8449fd57&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=2213bb7bedd24e0799c92509145673ee => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:53.102140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c54327-0b5a-4ac4-bae0-7b86e09a42e6 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.102481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c54327-0b5a-4ac4-bae0-7b86e09a42e6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.102729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c54327-0b5a-4ac4-bae0-7b86e09a42e6 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.104682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 102/209] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:53.115522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382fbdc-f9c3-4e35-bd1e-5764eb606854 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.115823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382fbdc-f9c3-4e35-bd1e-5764eb606854 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.116085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382fbdc-f9c3-4e35-bd1e-5764eb606854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.139887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f382fbdc-f9c3-4e35-bd1e-5764eb606854 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:53.141116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f382fbdc-f9c3-4e35-bd1e-5764eb606854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:53.237767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 108/210] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:53.276315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c54327-0b5a-4ac4-bae0-7b86e09a42e6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:53.295790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200668-b1eb-4ac8-b25c-c9a6a961dba6 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.296103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200668-b1eb-4ac8-b25c-c9a6a961dba6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.296519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200668-b1eb-4ac8-b25c-c9a6a961dba6 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.298510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 109/211] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:53.304864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141b88-723f-4a0c-85e5-56f283877594 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.305275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141b88-723f-4a0c-85e5-56f283877594 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.305556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141b88-723f-4a0c-85e5-56f283877594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.325390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ba141b88-723f-4a0c-85e5-56f283877594 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:53.327203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ba141b88-723f-4a0c-85e5-56f283877594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:53.383592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:53.406922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c54327-0b5a-4ac4-bae0-7b86e09a42e6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:53.417274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 110/212] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:53.445620 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141b88-723f-4a0c-85e5-56f283877594 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:53.448181 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:53.459386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45597c9a-0b21-447d-b609-bc7ec7dc7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:53.460207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45597c9a-0b21-447d-b609-bc7ec7dc7413 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.460493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45597c9a-0b21-447d-b609-bc7ec7dc7413 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.460767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45597c9a-0b21-447d-b609-bc7ec7dc7413 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.464485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45597c9a-0b21-447d-b609-bc7ec7dc7413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:53.465937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45597c9a-0b21-447d-b609-bc7ec7dc7413 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:53.467647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 103/213] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:53.473379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45597c9a-0b21-447d-b609-bc7ec7dc7413 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:53.568727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141b88-723f-4a0c-85e5-56f283877594 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:53.590717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45597c9a-0b21-447d-b609-bc7ec7dc7413 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:53.613896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82ab27-fb76-4501-88a4-c2e4a5fb8bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:53.615662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ab27-fb76-4501-88a4-c2e4a5fb8bf7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.616147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ab27-fb76-4501-88a4-c2e4a5fb8bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.616873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ab27-fb76-4501-88a4-c2e4a5fb8bf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.626651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e46b-7f86-440b-9426-edc3375aa7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:53.627451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e46b-7f86-440b-9426-edc3375aa7cb None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.627646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e46b-7f86-440b-9426-edc3375aa7cb None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.627894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e46b-7f86-440b-9426-edc3375aa7cb None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.628615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5e46b-7f86-440b-9426-edc3375aa7cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:53.630202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5e46b-7f86-440b-9426-edc3375aa7cb None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:53.631201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82ab27-fb76-4501-88a4-c2e4a5fb8bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-cf82ab27-fb76-4501-88a4-c2e4a5fb8bf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:53.641761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:53.642729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:53.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:53.646067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 111/214] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:53.652996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82ab27-fb76-4501-88a4-c2e4a5fb8bf7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:53.717660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:53.739231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 104/215] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:32:53 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:53.769526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82ab27-fb76-4501-88a4-c2e4a5fb8bf7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:53.811765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726e45-9e2f-429e-89ee-e21c9bfeed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:53.812460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726e45-9e2f-429e-89ee-e21c9bfeed9d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.812916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726e45-9e2f-429e-89ee-e21c9bfeed9d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.813257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726e45-9e2f-429e-89ee-e21c9bfeed9d None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.814180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726e45-9e2f-429e-89ee-e21c9bfeed9d None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:53.814496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726e45-9e2f-429e-89ee-e21c9bfeed9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:53.816012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726e45-9e2f-429e-89ee-e21c9bfeed9d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:53.827159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 112/216] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:53.835636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e46b-7f86-440b-9426-edc3375aa7cb None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:53.843345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13dac-68fc-45d2-86aa-e21c0bc657c3 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.843645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13dac-68fc-45d2-86aa-e21c0bc657c3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.843904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13dac-68fc-45d2-86aa-e21c0bc657c3 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.845441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 113/217] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:53.847256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:53.852130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a237bd6-e439-4106-8b15-c708c31028e4 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.852469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a237bd6-e439-4106-8b15-c708c31028e4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.852699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a237bd6-e439-4106-8b15-c708c31028e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.873082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-7a237bd6-e439-4106-8b15-c708c31028e4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:53.874628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7a237bd6-e439-4106-8b15-c708c31028e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:53.966146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 114/218] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:53.972683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e46b-7f86-440b-9426-edc3375aa7cb None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:53.989934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a237bd6-e439-4106-8b15-c708c31028e4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.024949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8cc23-1135-44ea-ab28-01ea23a16a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.026087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8cc23-1135-44ea-ab28-01ea23a16a41 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.026402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8cc23-1135-44ea-ab28-01ea23a16a41 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.026684 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8cc23-1135-44ea-ab28-01ea23a16a41 None admin] PATH_INFO: `/v3/users/0691013c6a5446808398caf9fadd79fb` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.042331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8cc23-1135-44ea-ab28-01ea23a16a41 None admin] RBAC: Authorizing `identity:get_user(user_id=0691013c6a5446808398caf9fadd79fb)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.044266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8cc23-1135-44ea-ab28-01ea23a16a41 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.046579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 105/219] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:53 2022] GET /identity/v3/users/0691013c6a5446808398caf9fadd79fb => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:54.052181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8cc23-1135-44ea-ab28-01ea23a16a41 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.062616 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.117535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a237bd6-e439-4106-8b15-c708c31028e4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.132282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.165298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d4bae-196a-42e8-802f-9da2bba6d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.166186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4bae-196a-42e8-802f-9da2bba6d21d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.166478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4bae-196a-42e8-802f-9da2bba6d21d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.166759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4bae-196a-42e8-802f-9da2bba6d21d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.179903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8cc23-1135-44ea-ab28-01ea23a16a41 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.180359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d4bae-196a-42e8-802f-9da2bba6d21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-099d4bae-196a-42e8-802f-9da2bba6d21d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:54.190677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:54.192447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:54.194034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 115/220] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:54.201355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d4bae-196a-42e8-802f-9da2bba6d21d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.218542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62ebd6-8949-4e0c-8c85-7f79082f1e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.219211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62ebd6-8949-4e0c-8c85-7f79082f1e69 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.219500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62ebd6-8949-4e0c-8c85-7f79082f1e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.219782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62ebd6-8949-4e0c-8c85-7f79082f1e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.295781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62ebd6-8949-4e0c-8c85-7f79082f1e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.297271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62ebd6-8949-4e0c-8c85-7f79082f1e69 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.316576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d4bae-196a-42e8-802f-9da2bba6d21d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.334075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.357484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.358449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.358884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.359393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.360411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:54.360895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.362599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.363253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.385821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 116/221] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:54.391768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.410258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 106/222] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:32:54.413978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62ebd6-8949-4e0c-8c85-7f79082f1e69 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.558393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62ebd6-8949-4e0c-8c85-7f79082f1e69 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.584402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f129c7-55be-41ab-be88-414f606cb452 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.624351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e05e9-ea59-4f1c-bb64-68e21ab649ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.625287 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e05e9-ea59-4f1c-bb64-68e21ab649ee None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.625583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e05e9-ea59-4f1c-bb64-68e21ab649ee None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.625865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e05e9-ea59-4f1c-bb64-68e21ab649ee None admin] PATH_INFO: `/v3/users/db2f9192fa8a45cc9b77fc83df6874e3` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.627312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e05e9-ea59-4f1c-bb64-68e21ab649ee None admin] RBAC: Authorizing `identity:get_user(user_id=db2f9192fa8a45cc9b77fc83df6874e3)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.629060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e05e9-ea59-4f1c-bb64-68e21ab649ee None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.630847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 117/223] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:54 2022] GET /identity/v3/users/db2f9192fa8a45cc9b77fc83df6874e3 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:54.637562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e05e9-ea59-4f1c-bb64-68e21ab649ee None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.674820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcae61-d69f-418b-8df7-762734311d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.675709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcae61-d69f-418b-8df7-762734311d11 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.675995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcae61-d69f-418b-8df7-762734311d11 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.676272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcae61-d69f-418b-8df7-762734311d11 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.677508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcae61-d69f-418b-8df7-762734311d11 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.678983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcae61-d69f-418b-8df7-762734311d11 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.683117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 107/224] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:54 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:54.687703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcae61-d69f-418b-8df7-762734311d11 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.695426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.757344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e05e9-ea59-4f1c-bb64-68e21ab649ee None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.784829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.795247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803b1ba-5f86-4cf5-8b94-cbc2ee98095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.796245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b1ba-5f86-4cf5-8b94-cbc2ee98095b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.796537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b1ba-5f86-4cf5-8b94-cbc2ee98095b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.796820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b1ba-5f86-4cf5-8b94-cbc2ee98095b None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.798261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803b1ba-5f86-4cf5-8b94-cbc2ee98095b None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.799802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803b1ba-5f86-4cf5-8b94-cbc2ee98095b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.802186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 118/225] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:54 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:54.808470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803b1ba-5f86-4cf5-8b94-cbc2ee98095b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.916219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803b1ba-5f86-4cf5-8b94-cbc2ee98095b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.920371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcae61-d69f-418b-8df7-762734311d11 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.929703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.952614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff628b-4679-4a21-922d-acaba21f593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.953610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff628b-4679-4a21-922d-acaba21f593a None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.955031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff628b-4679-4a21-922d-acaba21f593a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.955031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff628b-4679-4a21-922d-acaba21f593a None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/users/db2f9192fa8a45cc9b77fc83df6874e3/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.956554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff628b-4679-4a21-922d-acaba21f593a None admin] RBAC: Authorizing `identity:create_grant(project_id=60578e3e4a6e4935acb2a38bab0ac874, user_id=db2f9192fa8a45cc9b77fc83df6874e3, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.958366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff628b-4679-4a21-922d-acaba21f593a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.982989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bdebf-e163-49f4-82ff-f2ae1a4b4db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.983760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bdebf-e163-49f4-82ff-f2ae1a4b4db4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.984060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bdebf-e163-49f4-82ff-f2ae1a4b4db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.984359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bdebf-e163-49f4-82ff-f2ae1a4b4db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.985463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bdebf-e163-49f4-82ff-f2ae1a4b4db4 None admin] RBAC: Adding query filter params (role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874, user.id=0691013c6a5446808398caf9fadd79fb) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:54.986063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bdebf-e163-49f4-82ff-f2ae1a4b4db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.988041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bdebf-e163-49f4-82ff-f2ae1a4b4db4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.995905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 108/226] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:54 2022] GET /identity/v3/role_assignments?user.id=0691013c6a5446808398caf9fadd79fb&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:54.997125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05493a-a8d4-46ed-b3e8-bcdb6a203cf4 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.997472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05493a-a8d4-46ed-b3e8-bcdb6a203cf4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.003568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05493a-a8d4-46ed-b3e8-bcdb6a203cf4 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.003568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 109/227] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:55.005065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d865-8b4e-4e69-bcfd-02b9ed4f72a6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:55.005362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d865-8b4e-4e69-bcfd-02b9ed4f72a6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.005646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d865-8b4e-4e69-bcfd-02b9ed4f72a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.029062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 119/228] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:54 2022] PUT /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/users/db2f9192fa8a45cc9b77fc83df6874e3/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:32:55.036643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b4d0d865-8b4e-4e69-bcfd-02b9ed4f72a6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:55.037996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b4d0d865-8b4e-4e69-bcfd-02b9ed4f72a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:55.133539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 110/229] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:55.157640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff628b-4679-4a21-922d-acaba21f593a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:55.281264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff628b-4679-4a21-922d-acaba21f593a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:55.316482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc46eb4-6a65-4e04-aad3-79cac64c1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:55.317305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc46eb4-6a65-4e04-aad3-79cac64c1ccf None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:55.317590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc46eb4-6a65-4e04-aad3-79cac64c1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.317870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc46eb4-6a65-4e04-aad3-79cac64c1ccf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.329310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc46eb4-6a65-4e04-aad3-79cac64c1ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-cfc46eb4-6a65-4e04-aad3-79cac64c1ccf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:55.337949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:55.338874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:32:55.339704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 120/230] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:32:55.347184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d865-8b4e-4e69-bcfd-02b9ed4f72a6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:55.380935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:55.493014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d865-8b4e-4e69-bcfd-02b9ed4f72a6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:55.572661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:55.573264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:55.573551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.573831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.574623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:55.575208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:55.576604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:55.590639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 111/231] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:55.591053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc46eb4-6a65-4e04-aad3-79cac64c1ccf None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:55.659177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:55.769508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc46eb4-6a65-4e04-aad3-79cac64c1ccf None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:55.819695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36d25d-5f5a-43a8-9faf-e58d11090552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:55.820968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d25d-5f5a-43a8-9faf-e58d11090552 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:55.821491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d25d-5f5a-43a8-9faf-e58d11090552 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.822559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d25d-5f5a-43a8-9faf-e58d11090552 None admin] PATH_INFO: `/v3/users/db2f9192fa8a45cc9b77fc83df6874e3` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.824062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36d25d-5f5a-43a8-9faf-e58d11090552 None admin] RBAC: Authorizing `identity:get_user(user_id=db2f9192fa8a45cc9b77fc83df6874e3)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:55.825751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36d25d-5f5a-43a8-9faf-e58d11090552 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:55.827650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 121/232] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:55 2022] GET /identity/v3/users/db2f9192fa8a45cc9b77fc83df6874e3 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:55.833167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:55.934083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:55.946613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a874dd-4933-470e-ad55-7bfaebc72133 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:55.994428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18882c-f60f-4fd4-b440-baf7b2ff5018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:55.995714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18882c-f60f-4fd4-b440-baf7b2ff5018 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:55.995952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18882c-f60f-4fd4-b440-baf7b2ff5018 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.996234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18882c-f60f-4fd4-b440-baf7b2ff5018 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.997491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18882c-f60f-4fd4-b440-baf7b2ff5018 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:55.998982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18882c-f60f-4fd4-b440-baf7b2ff5018 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:56.001044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 112/233] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:55 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:56.006749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36d25d-5f5a-43a8-9faf-e58d11090552 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:56.174660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:56.178693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36d25d-5f5a-43a8-9faf-e58d11090552 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:56.231699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e353b6d-d4a3-4f77-a5fa-f0f839aaba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:56.232955 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e353b6d-d4a3-4f77-a5fa-f0f839aaba3c None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:56.233444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e353b6d-d4a3-4f77-a5fa-f0f839aaba3c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:56.233946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e353b6d-d4a3-4f77-a5fa-f0f839aaba3c None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/users/db2f9192fa8a45cc9b77fc83df6874e3/roles/0053c5c9a9f74809be6ecfcdeb35c100` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:56.236431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e353b6d-d4a3-4f77-a5fa-f0f839aaba3c None admin] RBAC: Authorizing `identity:create_grant(project_id=60578e3e4a6e4935acb2a38bab0ac874, user_id=db2f9192fa8a45cc9b77fc83df6874e3, role_id=0053c5c9a9f74809be6ecfcdeb35c100)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:56.238086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e353b6d-d4a3-4f77-a5fa-f0f839aaba3c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:56.325475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 122/234] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:56 2022] PUT /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/users/db2f9192fa8a45cc9b77fc83df6874e3/roles/0053c5c9a9f74809be6ecfcdeb35c100 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:32:56.586772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eabb2-05bb-4397-9312-0dc088571522 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:56.587154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eabb2-05bb-4397-9312-0dc088571522 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:56.587904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eabb2-05bb-4397-9312-0dc088571522 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:56.589439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 113/235] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:56.607199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71c3f-a39c-4ad0-a223-4e6d5ed6e4d9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:56.608175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71c3f-a39c-4ad0-a223-4e6d5ed6e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:56.608690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71c3f-a39c-4ad0-a223-4e6d5ed6e4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:56.630270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-81c71c3f-a39c-4ad0-a223-4e6d5ed6e4d9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:56.631525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-81c71c3f-a39c-4ad0-a223-4e6d5ed6e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:56.714029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 123/236] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:56.738972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eabb2-05bb-4397-9312-0dc088571522 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:56.746006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d2b5-7727-4218-b202-46c095b671e5 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:56.746593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d2b5-7727-4218-b202-46c095b671e5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:56.747042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d2b5-7727-4218-b202-46c095b671e5 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:56.749272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 124/237] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:56.755920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ced7-acba-4748-a2fe-2b03e2b434a0 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:56.756211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ced7-acba-4748-a2fe-2b03e2b434a0 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:56.756497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ced7-acba-4748-a2fe-2b03e2b434a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:56.793622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9bd6ced7-acba-4748-a2fe-2b03e2b434a0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:56.798182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9bd6ced7-acba-4748-a2fe-2b03e2b434a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:56.925134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eabb2-05bb-4397-9312-0dc088571522 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:56.960896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 125/238] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:56.978865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4119f43-5db9-48cd-9859-4003c216564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:56.979698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119f43-5db9-48cd-9859-4003c216564b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:56.979990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119f43-5db9-48cd-9859-4003c216564b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:56.980269 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119f43-5db9-48cd-9859-4003c216564b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:56.986794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6ced7-acba-4748-a2fe-2b03e2b434a0 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:57.010046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4119f43-5db9-48cd-9859-4003c216564b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-d4119f43-5db9-48cd-9859-4003c216564b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:57.021473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:57.022453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:32:57.023263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:57.030263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 114/239] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:57.030868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:57.031190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4119f43-5db9-48cd-9859-4003c216564b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:57.072780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:57.111479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6ced7-acba-4748-a2fe-2b03e2b434a0 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:57.148539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ebd7d-0765-41ea-9abd-624ffedd0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:57.149624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ebd7d-0765-41ea-9abd-624ffedd0e86 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.150083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ebd7d-0765-41ea-9abd-624ffedd0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.150552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ebd7d-0765-41ea-9abd-624ffedd0e86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.154926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ebd7d-0765-41ea-9abd-624ffedd0e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:57.156769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ebd7d-0765-41ea-9abd-624ffedd0e86 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:57.164611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 126/240] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:32:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:57.166784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ebd7d-0765-41ea-9abd-624ffedd0e86 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:57.278451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ebd7d-0765-41ea-9abd-624ffedd0e86 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:57.280010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4119f43-5db9-48cd-9859-4003c216564b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:57.294475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:57.315509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fc560-dd35-4801-9c40-eda24323fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:57.316516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fc560-dd35-4801-9c40-eda24323fe5e None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.316941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fc560-dd35-4801-9c40-eda24323fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.317356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fc560-dd35-4801-9c40-eda24323fe5e None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.318246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fc560-dd35-4801-9c40-eda24323fe5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:57.319817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fc560-dd35-4801-9c40-eda24323fe5e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:57.350962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:57.352125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.352659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.353609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.354588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:57.355063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:57.356816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:57.367481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 115/241] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:57.375560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:57.404235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 127/242] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:32:57 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:32:57.477091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8854-90a5-4313-a7e6-4c95101b4337 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.477606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8854-90a5-4313-a7e6-4c95101b4337 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.478674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8854-90a5-4313-a7e6-4c95101b4337 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.480578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 128/243] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:57.486619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b1ab-6911-4744-9be1-d42993d1d29b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.487058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b1ab-6911-4744-9be1-d42993d1d29b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.487238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b1ab-6911-4744-9be1-d42993d1d29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.518482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d933b1ab-6911-4744-9be1-d42993d1d29b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:57.519706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:57.521506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d933b1ab-6911-4744-9be1-d42993d1d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:57.550591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea2cb7-207d-46d2-bb01-84124b70656c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:57.611082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 129/244] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:57.612167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc777a-b8e9-4f93-afba-46673ccab438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:57.613231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc777a-b8e9-4f93-afba-46673ccab438 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.613511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06855ab8-1879-4b75-85b8-ada8b96edbeb None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.613811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06855ab8-1879-4b75-85b8-ada8b96edbeb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.613994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc777a-b8e9-4f93-afba-46673ccab438 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.614144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06855ab8-1879-4b75-85b8-ada8b96edbeb None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.614555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc777a-b8e9-4f93-afba-46673ccab438 None admin] PATH_INFO: `/v3/users/f6c5ad664c18427390716e30d7b2b069` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.622187 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 130/245] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:57.622413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c63e-e707-4025-b38b-828e133101f6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.622682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c63e-e707-4025-b38b-828e133101f6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.622963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c63e-e707-4025-b38b-828e133101f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.639048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc777a-b8e9-4f93-afba-46673ccab438 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5ad664c18427390716e30d7b2b069)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:57.641216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc777a-b8e9-4f93-afba-46673ccab438 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:57.642130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-eed5c63e-e707-4025-b38b-828e133101f6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:57.643338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-eed5c63e-e707-4025-b38b-828e133101f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:57.643757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 116/246] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:57 2022] GET /identity/v3/users/f6c5ad664c18427390716e30d7b2b069 => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:57.644533 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc777a-b8e9-4f93-afba-46673ccab438 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:57.739958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 131/247] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:32:57.741158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c63e-e707-4025-b38b-828e133101f6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:57.751531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:57.798061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc777a-b8e9-4f93-afba-46673ccab438 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:57.846497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63809d0-1b7a-4c6a-b7aa-0d6ddb8bb3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:57.847313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63809d0-1b7a-4c6a-b7aa-0d6ddb8bb3d8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.847594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63809d0-1b7a-4c6a-b7aa-0d6ddb8bb3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.847873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63809d0-1b7a-4c6a-b7aa-0d6ddb8bb3d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.851094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:57.861297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63809d0-1b7a-4c6a-b7aa-0d6ddb8bb3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-a63809d0-1b7a-4c6a-b7aa-0d6ddb8bb3d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:57.870735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:57.871767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 117/248] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:57.872865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63809d0-1b7a-4c6a-b7aa-0d6ddb8bb3d8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:57.900542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c63e-e707-4025-b38b-828e133101f6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:57.986318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0975c4-ae2f-497a-bd87-08d2648c3b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:57.986988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0975c4-ae2f-497a-bd87-08d2648c3b13 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.987273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0975c4-ae2f-497a-bd87-08d2648c3b13 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.987553 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0975c4-ae2f-497a-bd87-08d2648c3b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.017984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63809d0-1b7a-4c6a-b7aa-0d6ddb8bb3d8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:58.090574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f70e-6f3f-4a30-b7e1-a3ae32202e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:58.091742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f70e-6f3f-4a30-b7e1-a3ae32202e1e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.092275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f70e-6f3f-4a30-b7e1-a3ae32202e1e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.092766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f70e-6f3f-4a30-b7e1-a3ae32202e1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.097667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0975c4-ae2f-497a-bd87-08d2648c3b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:58.099111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0975c4-ae2f-497a-bd87-08d2648c3b13 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:58.102092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:58.113813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f70e-6f3f-4a30-b7e1-a3ae32202e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-fee5f70e-6f3f-4a30-b7e1-a3ae32202e1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:58.128947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:58.131516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 118/249] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:58.132353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f70e-6f3f-4a30-b7e1-a3ae32202e1e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:58.211736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:58.219439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 132/250] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:58.220565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0975c4-ae2f-497a-bd87-08d2648c3b13 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:58.270802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f70e-6f3f-4a30-b7e1-a3ae32202e1e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:58.311330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:58.312011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.312301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.312582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.313397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:58.313898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:58.315171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:58.332334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 119/251] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:58.338232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:58.346699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0975c4-ae2f-497a-bd87-08d2648c3b13 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:58.365135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:58.417352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:58.418455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.420123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.420696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.421710 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:58.422406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:58.424767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:58.442930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 133/252] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:58.445158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:58.588016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de770f1-928a-4f9b-8b67-20f38a08ce30 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:58.626909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:58.660179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeda16-119a-4c98-b808-18f402b3bec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:58.661059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeda16-119a-4c98-b808-18f402b3bec2 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.661342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeda16-119a-4c98-b808-18f402b3bec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.661614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeda16-119a-4c98-b808-18f402b3bec2 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.663039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfeda16-119a-4c98-b808-18f402b3bec2 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:58.664493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfeda16-119a-4c98-b808-18f402b3bec2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:58.672988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 120/253] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:58 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:58.673949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeda16-119a-4c98-b808-18f402b3bec2 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:58.724545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d2021-5288-4e9c-9424-8198adf0f1d4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:58.804827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afabc7-2300-49bf-9358-d2fa41f5e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:58.805711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afabc7-2300-49bf-9358-d2fa41f5e87c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.806549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afabc7-2300-49bf-9358-d2fa41f5e87c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.806831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afabc7-2300-49bf-9358-d2fa41f5e87c None admin] PATH_INFO: `/v3/users/db2f9192fa8a45cc9b77fc83df6874e3` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.812477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afabc7-2300-49bf-9358-d2fa41f5e87c None admin] RBAC: Authorizing `identity:get_user(user_id=db2f9192fa8a45cc9b77fc83df6874e3)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:58.813945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afabc7-2300-49bf-9358-d2fa41f5e87c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:58.815659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 134/254] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:58 2022] GET /identity/v3/users/db2f9192fa8a45cc9b77fc83df6874e3 => generated 283 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:58.821409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afabc7-2300-49bf-9358-d2fa41f5e87c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:58.889934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:58.901213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeda16-119a-4c98-b808-18f402b3bec2 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:58.970343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187460-87a1-4cac-8ee6-5545d1f3fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:58.971231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187460-87a1-4cac-8ee6-5545d1f3fe77 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.971516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187460-87a1-4cac-8ee6-5545d1f3fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.971792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187460-87a1-4cac-8ee6-5545d1f3fe77 None admin] PATH_INFO: `/v3/users/0691013c6a5446808398caf9fadd79fb` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.974516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc187460-87a1-4cac-8ee6-5545d1f3fe77 None admin] RBAC: Authorizing `identity:get_user(user_id=0691013c6a5446808398caf9fadd79fb)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:58.976015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc187460-87a1-4cac-8ee6-5545d1f3fe77 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:58.977758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 121/255] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:58 2022] GET /identity/v3/users/0691013c6a5446808398caf9fadd79fb => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:58.979090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187460-87a1-4cac-8ee6-5545d1f3fe77 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:59.005573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afabc7-2300-49bf-9358-d2fa41f5e87c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:59.074473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:59.085494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:59.094323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.094323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.094323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.094323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] RBAC: Adding query filter params (role.id=2213bb7bedd24e0799c92509145673ee, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874, user.id=f6c5ad664c18427390716e30d7b2b069) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:59.094323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:59.094323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:59.100335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 135/256] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:58 2022] GET /identity/v3/role_assignments?user.id=f6c5ad664c18427390716e30d7b2b069&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=2213bb7bedd24e0799c92509145673ee => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:59.101191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:59.154924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187460-87a1-4cac-8ee6-5545d1f3fe77 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:59.193413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10d37-0fae-4aa6-88f7-484ca0b5197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:59.194222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10d37-0fae-4aa6-88f7-484ca0b5197e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.194510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10d37-0fae-4aa6-88f7-484ca0b5197e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.194793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10d37-0fae-4aa6-88f7-484ca0b5197e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.269560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db10d37-0fae-4aa6-88f7-484ca0b5197e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:59.271189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db10d37-0fae-4aa6-88f7-484ca0b5197e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:59.343719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:59.352221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:59.358231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5a71f-bc3f-440e-8435-79060e49748d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:59.413677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 122/257] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:32:59.414799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fb48-c913-4da6-a0d9-aaedaa06f2e9 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.415089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fb48-c913-4da6-a0d9-aaedaa06f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.415419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fb48-c913-4da6-a0d9-aaedaa06f2e9 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.417222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 123/258] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:59.420822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4fb48-c913-4da6-a0d9-aaedaa06f2e9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:59.428637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c32920-4b60-416d-905e-7573fa7b47e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:59.429520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32920-4b60-416d-905e-7573fa7b47e3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.429801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32920-4b60-416d-905e-7573fa7b47e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.430081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32920-4b60-416d-905e-7573fa7b47e3 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.435858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c32920-4b60-416d-905e-7573fa7b47e3 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:59.437361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c32920-4b60-416d-905e-7573fa7b47e3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:59.439162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 136/259] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:59 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:59.440366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10213c-504b-465f-a9ee-440d21708d2e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.440652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10213c-504b-465f-a9ee-440d21708d2e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.440928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10213c-504b-465f-a9ee-440d21708d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.472788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-bd10213c-504b-465f-a9ee-440d21708d2e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:59.474772 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bd10213c-504b-465f-a9ee-440d21708d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:59.600980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 137/260] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:32:59.601816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10213c-504b-465f-a9ee-440d21708d2e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:59.613102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4fb48-c913-4da6-a0d9-aaedaa06f2e9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:59.674282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bedc4-0a80-4b77-b591-edf681bea20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:59.675098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bedc4-0a80-4b77-b591-edf681bea20b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.675380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bedc4-0a80-4b77-b591-edf681bea20b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.675656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bedc4-0a80-4b77-b591-edf681bea20b None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.677254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bedc4-0a80-4b77-b591-edf681bea20b None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:59.678805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bedc4-0a80-4b77-b591-edf681bea20b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:59.680876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 124/261] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:59 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:59.681675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bedc4-0a80-4b77-b591-edf681bea20b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:59.718899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:59.785677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:59.793334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10213c-504b-465f-a9ee-440d21708d2e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:59.833122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608e954-7577-4319-8c95-2615a53edc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:59.834411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608e954-7577-4319-8c95-2615a53edc60 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.834932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608e954-7577-4319-8c95-2615a53edc60 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.835389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608e954-7577-4319-8c95-2615a53edc60 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/users/0691013c6a5446808398caf9fadd79fb/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.839169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608e954-7577-4319-8c95-2615a53edc60 None admin] RBAC: Authorizing `identity:create_grant(project_id=60578e3e4a6e4935acb2a38bab0ac874, user_id=0691013c6a5446808398caf9fadd79fb, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:59.840836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608e954-7577-4319-8c95-2615a53edc60 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:59.872179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bedc4-0a80-4b77-b591-edf681bea20b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:59.912530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 138/262] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:59 2022] PUT /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/users/0691013c6a5446808398caf9fadd79fb/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:32:59.913637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608e954-7577-4319-8c95-2615a53edc60 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:59.925528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca235a-9ab1-49f4-a5b8-f82844dbf10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:59.926712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca235a-9ab1-49f4-a5b8-f82844dbf10b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.927496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca235a-9ab1-49f4-a5b8-f82844dbf10b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.927978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca235a-9ab1-49f4-a5b8-f82844dbf10b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.950080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca235a-9ab1-49f4-a5b8-f82844dbf10b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-abca235a-9ab1-49f4-a5b8-f82844dbf10b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:59.969506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:59.970529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:32:59.971354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:32:59.973852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 125/263] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:32:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:59.977587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e5eb-37dd-4657-97c8-9a6dd247a0d6 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.978732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e5eb-37dd-4657-97c8-9a6dd247a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.979378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e5eb-37dd-4657-97c8-9a6dd247a0d6 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.983364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 126/264] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:32:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:59.984521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9e5eb-37dd-4657-97c8-9a6dd247a0d6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:00.122696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608e954-7577-4319-8c95-2615a53edc60 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:00.143310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:00.164490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9e5eb-37dd-4657-97c8-9a6dd247a0d6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:00.164845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db106e54-e83e-49e9-86d7-b679e8aaaad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:00.165785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106e54-e83e-49e9-86d7-b679e8aaaad9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.166366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106e54-e83e-49e9-86d7-b679e8aaaad9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.166844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106e54-e83e-49e9-86d7-b679e8aaaad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.167883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db106e54-e83e-49e9-86d7-b679e8aaaad9 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874, user.id=db2f9192fa8a45cc9b77fc83df6874e3) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:00.168396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db106e54-e83e-49e9-86d7-b679e8aaaad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:00.170922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db106e54-e83e-49e9-86d7-b679e8aaaad9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:00.180544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 139/265] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:59 2022] GET /identity/v3/role_assignments?user.id=db2f9192fa8a45cc9b77fc83df6874e3&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:00.183472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdb4b4-a5a2-4052-9407-cc02323d3aec None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.183756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdb4b4-a5a2-4052-9407-cc02323d3aec None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.184030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdb4b4-a5a2-4052-9407-cc02323d3aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.205370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-afcdb4b4-a5a2-4052-9407-cc02323d3aec None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:00.207324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-afcdb4b4-a5a2-4052-9407-cc02323d3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:00.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4e194-12be-4a98-a3d9-4c92062f459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:00.211163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e194-12be-4a98-a3d9-4c92062f459a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.211460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e194-12be-4a98-a3d9-4c92062f459a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.211735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e194-12be-4a98-a3d9-4c92062f459a None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.212530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4e194-12be-4a98-a3d9-4c92062f459a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:00.213843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4e194-12be-4a98-a3d9-4c92062f459a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:00.215303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4e194-12be-4a98-a3d9-4c92062f459a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:00.226303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 127/266] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:32:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:00.227837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:00.229383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4788-5a3a-4c9a-8a6c-71ea48b0aa80 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.229672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4788-5a3a-4c9a-8a6c-71ea48b0aa80 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.229951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4788-5a3a-4c9a-8a6c-71ea48b0aa80 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.232001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 128/267] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:00.236987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b4788-5a3a-4c9a-8a6c-71ea48b0aa80 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:00.299509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 140/268] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:00.300912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e768-3bbc-4be6-baa6-cc1ca7124785 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.301207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e768-3bbc-4be6-baa6-cc1ca7124785 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.301486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e768-3bbc-4be6-baa6-cc1ca7124785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.326206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b387e768-3bbc-4be6-baa6-cc1ca7124785 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:00.327677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b387e768-3bbc-4be6-baa6-cc1ca7124785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:00.378704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b4788-5a3a-4c9a-8a6c-71ea48b0aa80 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:00.414692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 141/269] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:00.416105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e768-3bbc-4be6-baa6-cc1ca7124785 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:00.429511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796953-7387-46d1-acaf-bc66e114c6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:00.430498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796953-7387-46d1-acaf-bc66e114c6da None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.433310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796953-7387-46d1-acaf-bc66e114c6da None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.433541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796953-7387-46d1-acaf-bc66e114c6da None admin] PATH_INFO: `/v3/users/db2f9192fa8a45cc9b77fc83df6874e3` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.436870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796953-7387-46d1-acaf-bc66e114c6da None admin] RBAC: Authorizing `identity:get_user(user_id=db2f9192fa8a45cc9b77fc83df6874e3)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:00.438672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796953-7387-46d1-acaf-bc66e114c6da None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:00.444333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 129/270] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:00 2022] GET /identity/v3/users/db2f9192fa8a45cc9b77fc83df6874e3 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:00.449118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796953-7387-46d1-acaf-bc66e114c6da None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:00.469046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:00.537097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:00.564273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e768-3bbc-4be6-baa6-cc1ca7124785 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:00.589604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796953-7387-46d1-acaf-bc66e114c6da None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:00.620647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ba756-22b8-4b67-b7dd-978c18742c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:00.621776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba756-22b8-4b67-b7dd-978c18742c99 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.622070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba756-22b8-4b67-b7dd-978c18742c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.622406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba756-22b8-4b67-b7dd-978c18742c99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.635592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff9d8b-0984-48b6-9243-e37778341e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:00.636577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff9d8b-0984-48b6-9243-e37778341e26 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.637206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff9d8b-0984-48b6-9243-e37778341e26 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.637759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff9d8b-0984-48b6-9243-e37778341e26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.638026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ba756-22b8-4b67-b7dd-978c18742c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-161ba756-22b8-4b67-b7dd-978c18742c99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:00.648881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:00.650631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:00.651614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 142/271] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:00.652283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ba756-22b8-4b67-b7dd-978c18742c99 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:00.750329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff9d8b-0984-48b6-9243-e37778341e26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:00.752941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff9d8b-0984-48b6-9243-e37778341e26 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:00.772946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:00.783150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ba756-22b8-4b67-b7dd-978c18742c99 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:00.830777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794b54-9a7c-4b0b-8590-d18025fe8d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:00.833003 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794b54-9a7c-4b0b-8590-d18025fe8d08 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.833749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794b54-9a7c-4b0b-8590-d18025fe8d08 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.834253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794b54-9a7c-4b0b-8590-d18025fe8d08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.835674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794b54-9a7c-4b0b-8590-d18025fe8d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:00.838366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794b54-9a7c-4b0b-8590-d18025fe8d08 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:00.846282 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 143/272] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:00.847171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794b54-9a7c-4b0b-8590-d18025fe8d08 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:00.861702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:00.880144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 130/273] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:00.880988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff9d8b-0984-48b6-9243-e37778341e26 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:00.980498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794b54-9a7c-4b0b-8590-d18025fe8d08 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:01.013556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff9d8b-0984-48b6-9243-e37778341e26 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:01.019266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:01.019947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.020235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.020519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.021853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:01.022280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:01.024342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:01.031395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:01.034375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 144/274] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:01.035317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:01.059735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafac57-17fb-463b-8257-7ed9c2709122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:01.062742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafac57-17fb-463b-8257-7ed9c2709122 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.063318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafac57-17fb-463b-8257-7ed9c2709122 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.063769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafac57-17fb-463b-8257-7ed9c2709122 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.065570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafac57-17fb-463b-8257-7ed9c2709122 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:01.067477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafac57-17fb-463b-8257-7ed9c2709122 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:01.125497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:01.158632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7759-f0b2-4374-9d24-41589063f862 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:01.188661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 131/275] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:33:00 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:01.190618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafac57-17fb-463b-8257-7ed9c2709122 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:01.218144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b7c70-9e7e-4b96-b997-5beba6c72ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:01.218144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b7c70-9e7e-4b96-b997-5beba6c72ef2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.218144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b7c70-9e7e-4b96-b997-5beba6c72ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.218144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b7c70-9e7e-4b96-b997-5beba6c72ef2 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.218578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b7c70-9e7e-4b96-b997-5beba6c72ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:01.218578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b7c70-9e7e-4b96-b997-5beba6c72ef2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:01.220154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 145/276] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:01 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:01.226326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b7c70-9e7e-4b96-b997-5beba6c72ef2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:01.402429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafac57-17fb-463b-8257-7ed9c2709122 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:01.440379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b7c70-9e7e-4b96-b997-5beba6c72ef2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:01.445198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d572c2b-a0d0-413d-aad5-0440e9fab08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:01.445955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572c2b-a0d0-413d-aad5-0440e9fab08d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.446280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572c2b-a0d0-413d-aad5-0440e9fab08d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.446662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572c2b-a0d0-413d-aad5-0440e9fab08d None admin] PATH_INFO: `/v3/users/0ef93d8bb6c644eb95042519a1038b2b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.464891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d572c2b-a0d0-413d-aad5-0440e9fab08d None admin] RBAC: Authorizing `identity:get_user(user_id=0ef93d8bb6c644eb95042519a1038b2b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:01.466450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d572c2b-a0d0-413d-aad5-0440e9fab08d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:01.468564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 132/277] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:01 2022] GET /identity/v3/users/0ef93d8bb6c644eb95042519a1038b2b => generated 293 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:01.475046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d572c2b-a0d0-413d-aad5-0440e9fab08d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:01.493016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06980775-8ceb-4b02-bd72-f2e3d6fd8331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:01.493847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06980775-8ceb-4b02-bd72-f2e3d6fd8331 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.494981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06980775-8ceb-4b02-bd72-f2e3d6fd8331 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.494981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06980775-8ceb-4b02-bd72-f2e3d6fd8331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.495303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06980775-8ceb-4b02-bd72-f2e3d6fd8331 None admin] RBAC: Adding query filter params (role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874, user.id=db2f9192fa8a45cc9b77fc83df6874e3) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:01.495624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06980775-8ceb-4b02-bd72-f2e3d6fd8331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:01.497089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06980775-8ceb-4b02-bd72-f2e3d6fd8331 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:01.505442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 146/278] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:01 2022] GET /identity/v3/role_assignments?user.id=db2f9192fa8a45cc9b77fc83df6874e3&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:01.505745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e955af-25bc-4a07-9776-6b7f105fe157 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.506040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e955af-25bc-4a07-9776-6b7f105fe157 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.506370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e955af-25bc-4a07-9776-6b7f105fe157 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.511946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 147/279] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:01.513407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1075f1-8ae5-42f6-a08e-1f3344d0dd4e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.513688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1075f1-8ae5-42f6-a08e-1f3344d0dd4e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.513979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1075f1-8ae5-42f6-a08e-1f3344d0dd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.520046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:01.521423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:01.535878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-cb1075f1-8ae5-42f6-a08e-1f3344d0dd4e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:01.537107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cb1075f1-8ae5-42f6-a08e-1f3344d0dd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:01.631263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d572c2b-a0d0-413d-aad5-0440e9fab08d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:01.635950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 148/280] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:01.663492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1075f1-8ae5-42f6-a08e-1f3344d0dd4e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:01.676195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:01.677304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.677590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.678179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.679039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] RBAC: Adding query filter params (role.id=20ef9cdb3c3c4a79bfacad902829d018, user.id=0ef93d8bb6c644eb95042519a1038b2b, scope.system=all) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:01.679354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:01.681689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:01.689457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 133/281] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Jul 11 14:33:01 2022] GET /identity/v3/role_assignments?user.id=0ef93d8bb6c644eb95042519a1038b2b&scope.system=all&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:01.802628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1075f1-8ae5-42f6-a08e-1f3344d0dd4e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:01.842657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:01.849267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602cded-8d2a-4e85-a119-12f28a18ae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:01.850185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602cded-8d2a-4e85-a119-12f28a18ae2f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:01.850470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602cded-8d2a-4e85-a119-12f28a18ae2f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:01.850749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602cded-8d2a-4e85-a119-12f28a18ae2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:01.863175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602cded-8d2a-4e85-a119-12f28a18ae2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-0602cded-8d2a-4e85-a119-12f28a18ae2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:01.871320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:01.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:01.873611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 149/282] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:01.881660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:01.997177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:02.006927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80004380-fff3-496d-9033-d619618f9a8c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:02.059736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:02.060415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.060694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.060970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.061733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:02.062042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:02.063462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:02.076700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 134/283] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:02.082217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602cded-8d2a-4e85-a119-12f28a18ae2f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:02.195365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602cded-8d2a-4e85-a119-12f28a18ae2f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:02.232439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9be1d3-5247-43db-aa3f-5d830c15ea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:02.233334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9be1d3-5247-43db-aa3f-5d830c15ea73 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.233619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9be1d3-5247-43db-aa3f-5d830c15ea73 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.233902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9be1d3-5247-43db-aa3f-5d830c15ea73 None admin] PATH_INFO: `/v3/users/f6c5ad664c18427390716e30d7b2b069` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.235184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9be1d3-5247-43db-aa3f-5d830c15ea73 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5ad664c18427390716e30d7b2b069)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:02.236714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9be1d3-5247-43db-aa3f-5d830c15ea73 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:02.238795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 150/284] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:02 2022] GET /identity/v3/users/f6c5ad664c18427390716e30d7b2b069 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:02.244901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:02.377514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3fef-54fc-4a26-9f83-422a0a6511f5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:02.414481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd102c6-6684-49b0-92ba-d3609946208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:02.415391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd102c6-6684-49b0-92ba-d3609946208d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.415681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd102c6-6684-49b0-92ba-d3609946208d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.416014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd102c6-6684-49b0-92ba-d3609946208d None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.417656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd102c6-6684-49b0-92ba-d3609946208d None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:02.419151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd102c6-6684-49b0-92ba-d3609946208d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:02.421180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 135/285] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:02 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:02.427316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9be1d3-5247-43db-aa3f-5d830c15ea73 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:02.483569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d73fd2-67be-4dd8-b066-adcce0ac59e0 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.484210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d73fd2-67be-4dd8-b066-adcce0ac59e0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.484698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d73fd2-67be-4dd8-b066-adcce0ac59e0 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.486650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 136/286] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:02.506537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31965fc-5286-4c9f-8442-3b509726be00 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.507153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31965fc-5286-4c9f-8442-3b509726be00 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.507642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31965fc-5286-4c9f-8442-3b509726be00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.513199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:02.536280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a31965fc-5286-4c9f-8442-3b509726be00 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:02.537961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a31965fc-5286-4c9f-8442-3b509726be00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:02.556820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9be1d3-5247-43db-aa3f-5d830c15ea73 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:02.561358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:02.602384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b65950-a4c0-46e0-9efa-69b0f6f3e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:02.603931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65950-a4c0-46e0-9efa-69b0f6f3e040 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.604969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65950-a4c0-46e0-9efa-69b0f6f3e040 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.604969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65950-a4c0-46e0-9efa-69b0f6f3e040 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/users/f6c5ad664c18427390716e30d7b2b069/roles/2213bb7bedd24e0799c92509145673ee` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.606627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b65950-a4c0-46e0-9efa-69b0f6f3e040 None admin] RBAC: Authorizing `identity:create_grant(project_id=60578e3e4a6e4935acb2a38bab0ac874, user_id=f6c5ad664c18427390716e30d7b2b069, role_id=2213bb7bedd24e0799c92509145673ee)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:02.608104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b65950-a4c0-46e0-9efa-69b0f6f3e040 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:02.646084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 137/287] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:02.671102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31965fc-5286-4c9f-8442-3b509726be00 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:02.690713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 151/288] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:02 2022] PUT /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/users/f6c5ad664c18427390716e30d7b2b069/roles/2213bb7bedd24e0799c92509145673ee => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:02.798640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31965fc-5286-4c9f-8442-3b509726be00 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:02.836867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce71b-2400-40cd-86cb-e6cf17785c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:02.838293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce71b-2400-40cd-86cb-e6cf17785c6d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.838582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce71b-2400-40cd-86cb-e6cf17785c6d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.838861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce71b-2400-40cd-86cb-e6cf17785c6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.851090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ce71b-2400-40cd-86cb-e6cf17785c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-497ce71b-2400-40cd-86cb-e6cf17785c6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:02.859189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:02.860188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:02.861014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 138/289] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:02.866604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b65950-a4c0-46e0-9efa-69b0f6f3e040 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:02.994965 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b65950-a4c0-46e0-9efa-69b0f6f3e040 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:03.016261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:03.036947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:03.037631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:03.037917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:03.038233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:03.038995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:03.039305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:03.040734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:03.049559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 152/290] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:03.055182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce71b-2400-40cd-86cb-e6cf17785c6d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:03.079901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:03.206032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce71b-2400-40cd-86cb-e6cf17785c6d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:03.251790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b733a12-854e-4df3-a376-da36eb4bd224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:03.253445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b733a12-854e-4df3-a376-da36eb4bd224 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:03.253935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b733a12-854e-4df3-a376-da36eb4bd224 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:03.254497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b733a12-854e-4df3-a376-da36eb4bd224 None admin] PATH_INFO: `/v3/users/0691013c6a5446808398caf9fadd79fb` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:03.255970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b733a12-854e-4df3-a376-da36eb4bd224 None admin] RBAC: Authorizing `identity:get_user(user_id=0691013c6a5446808398caf9fadd79fb)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:03.257718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b733a12-854e-4df3-a376-da36eb4bd224 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:03.260512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 139/291] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:03 2022] GET /identity/v3/users/0691013c6a5446808398caf9fadd79fb => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:03.265879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:03.407454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977def2-0a9a-422d-ab32-571d85962842 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:03.443568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf45e-fd9b-40d4-8ef1-da52801622ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:03.444227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf45e-fd9b-40d4-8ef1-da52801622ce None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:03.444513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf45e-fd9b-40d4-8ef1-da52801622ce None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:03.444796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf45e-fd9b-40d4-8ef1-da52801622ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:03.496021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:03.515587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf45e-fd9b-40d4-8ef1-da52801622ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:03.516070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf45e-fd9b-40d4-8ef1-da52801622ce None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:03.618061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 153/292] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:03.627198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b733a12-854e-4df3-a376-da36eb4bd224 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:03.750124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:03.779311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b733a12-854e-4df3-a376-da36eb4bd224 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:03.836181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f29de1-6a39-4e74-b824-6591ff51ad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:03.837685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29de1-6a39-4e74-b824-6591ff51ad2b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:03.837973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29de1-6a39-4e74-b824-6591ff51ad2b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:03.838279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29de1-6a39-4e74-b824-6591ff51ad2b None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:03.843233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f29de1-6a39-4e74-b824-6591ff51ad2b None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:03.844877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f29de1-6a39-4e74-b824-6591ff51ad2b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:03.847011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 140/293] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:03 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:03.853630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf45e-fd9b-40d4-8ef1-da52801622ce None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:03.950526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:03.968766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf45e-fd9b-40d4-8ef1-da52801622ce None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:04.004175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02e738-e2fc-4126-8773-f6082553ea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:04.004842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02e738-e2fc-4126-8773-f6082553ea71 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.005127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02e738-e2fc-4126-8773-f6082553ea71 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.005405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02e738-e2fc-4126-8773-f6082553ea71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.006279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02e738-e2fc-4126-8773-f6082553ea71 None admin] RBAC: Adding query filter params (role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874, user.id=0691013c6a5446808398caf9fadd79fb) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:04.006598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02e738-e2fc-4126-8773-f6082553ea71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:04.008051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02e738-e2fc-4126-8773-f6082553ea71 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:04.015440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 154/294] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:03 2022] GET /identity/v3/role_assignments?user.id=0691013c6a5446808398caf9fadd79fb&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:04.247463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318d01-0edb-45f1-b39c-bfa8ddca7cb7 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.247834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318d01-0edb-45f1-b39c-bfa8ddca7cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.248030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318d01-0edb-45f1-b39c-bfa8ddca7cb7 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.249677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 141/295] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:04.254884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc451-a6b1-4495-8a98-5593cadd1f38 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.255178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc451-a6b1-4495-8a98-5593cadd1f38 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.255454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc451-a6b1-4495-8a98-5593cadd1f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.273632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-851dc451-a6b1-4495-8a98-5593cadd1f38 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:04.275474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-851dc451-a6b1-4495-8a98-5593cadd1f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:04.348170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 155/296] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:04.371736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318d01-0edb-45f1-b39c-bfa8ddca7cb7 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:04.465251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d38816-460a-479d-8b00-58e0de766bc6 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.465703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d38816-460a-479d-8b00-58e0de766bc6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.465850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d38816-460a-479d-8b00-58e0de766bc6 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.467208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 156/297] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:04.472739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3b4b2-c12d-496c-88ae-11ba04a2e3d4 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.473015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3b4b2-c12d-496c-88ae-11ba04a2e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.473301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3b4b2-c12d-496c-88ae-11ba04a2e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.507182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f6e3b4b2-c12d-496c-88ae-11ba04a2e3d4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:04.508502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f6e3b4b2-c12d-496c-88ae-11ba04a2e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:04.526994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318d01-0edb-45f1-b39c-bfa8ddca7cb7 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:04.569246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a1ae3-b329-4acb-9147-c7c62afd7c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:04.571041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a1ae3-b329-4acb-9147-c7c62afd7c1f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.571521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a1ae3-b329-4acb-9147-c7c62afd7c1f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.572695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a1ae3-b329-4acb-9147-c7c62afd7c1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.574304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a1ae3-b329-4acb-9147-c7c62afd7c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:04.576298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a1ae3-b329-4acb-9147-c7c62afd7c1f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:04.578673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 142/298] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:04.586345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a1ae3-b329-4acb-9147-c7c62afd7c1f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:04.602209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 157/299] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:04.604431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ceb95-e9cd-4857-92b3-612fb55ae1ad None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.604691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ceb95-e9cd-4857-92b3-612fb55ae1ad None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.605072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ceb95-e9cd-4857-92b3-612fb55ae1ad None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.606813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 158/300] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:04.610946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:04.612633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac460d2-fea0-4dcc-b833-3a6b739ac73d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.613163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac460d2-fea0-4dcc-b833-3a6b739ac73d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.613640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac460d2-fea0-4dcc-b833-3a6b739ac73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.627543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:04.631674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-eac460d2-fea0-4dcc-b833-3a6b739ac73d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:04.632890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-eac460d2-fea0-4dcc-b833-3a6b739ac73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:04.700486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a1ae3-b329-4acb-9147-c7c62afd7c1f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:04.704777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 159/301] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:04.705775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac460d2-fea0-4dcc-b833-3a6b739ac73d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:04.753008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e181f-9133-4fb7-a070-a6902adba1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:04.753693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e181f-9133-4fb7-a070-a6902adba1e8 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.754387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e181f-9133-4fb7-a070-a6902adba1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.754675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e181f-9133-4fb7-a070-a6902adba1e8 None admin] PATH_INFO: `/v3/groups` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.755697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e181f-9133-4fb7-a070-a6902adba1e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:04.757147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e181f-9133-4fb7-a070-a6902adba1e8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:04.817975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac460d2-fea0-4dcc-b833-3a6b739ac73d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:04.846143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 143/302] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Jul 11 14:33:04 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:04.846143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e181f-9133-4fb7-a070-a6902adba1e8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:04.872195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219b92-4b51-4b0e-9c19-8196897ee97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:04.873080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219b92-4b51-4b0e-9c19-8196897ee97f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.873367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219b92-4b51-4b0e-9c19-8196897ee97f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.873641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219b92-4b51-4b0e-9c19-8196897ee97f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.878118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:04.893272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d219b92-4b51-4b0e-9c19-8196897ee97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-4d219b92-4b51-4b0e-9c19-8196897ee97f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:04.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:04.906409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:04.907210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:04.907820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 160/303] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:04.916597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219b92-4b51-4b0e-9c19-8196897ee97f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:04.961961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:04.994484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e181f-9133-4fb7-a070-a6902adba1e8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.036615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2240-03e3-45e5-9639-69f0b9fc6757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.037426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2240-03e3-45e5-9639-69f0b9fc6757 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.037714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2240-03e3-45e5-9639-69f0b9fc6757 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.037993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2240-03e3-45e5-9639-69f0b9fc6757 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.052827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219b92-4b51-4b0e-9c19-8196897ee97f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.054218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2240-03e3-45e5-9639-69f0b9fc6757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-76fd2240-03e3-45e5-9639-69f0b9fc6757 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:05.064238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:05.065273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:05.066091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:05.066960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 144/304] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:05.073969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2240-03e3-45e5-9639-69f0b9fc6757 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.101301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.102558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.103089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.103686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.104448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:05.105119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:05.106532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:05.115860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 161/305] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:05.125862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.205670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.216071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2240-03e3-45e5-9639-69f0b9fc6757 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.265891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f13ff-9359-4200-96b1-0704d2a42cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.266879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f13ff-9359-4200-96b1-0704d2a42cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.267233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f13ff-9359-4200-96b1-0704d2a42cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.267708 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f13ff-9359-4200-96b1-0704d2a42cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.268693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f13ff-9359-4200-96b1-0704d2a42cc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:05.269138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f13ff-9359-4200-96b1-0704d2a42cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:05.270657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f13ff-9359-4200-96b1-0704d2a42cc4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:05.271283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528652b9-17bd-4f09-a88e-13e652f6042f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.272621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.281273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 145/306] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:05.282619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2e46c-31e0-406c-8e9c-99e994b85704 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.282909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2e46c-31e0-406c-8e9c-99e994b85704 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.288734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2e46c-31e0-406c-8e9c-99e994b85704 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.288734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 146/307] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:05.289550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2e46c-31e0-406c-8e9c-99e994b85704 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.316130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab709a-743a-4abb-b16c-ec1466da694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.317019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab709a-743a-4abb-b16c-ec1466da694b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.317310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab709a-743a-4abb-b16c-ec1466da694b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.317590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab709a-743a-4abb-b16c-ec1466da694b None admin] PATH_INFO: `/v3/users/c389c4e0f0ee4c02b1324b1fcae9e7cc` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.333356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab709a-743a-4abb-b16c-ec1466da694b None admin] RBAC: Authorizing `identity:get_user(user_id=c389c4e0f0ee4c02b1324b1fcae9e7cc)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:05.334868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab709a-743a-4abb-b16c-ec1466da694b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:05.336756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 162/308] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/users/c389c4e0f0ee4c02b1324b1fcae9e7cc => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:05.342697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68094-e7fb-4783-a746-d7dc100807bb None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.342990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68094-e7fb-4783-a746-d7dc100807bb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.343273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68094-e7fb-4783-a746-d7dc100807bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.359770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f3a68094-e7fb-4783-a746-d7dc100807bb None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:05.360967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f3a68094-e7fb-4783-a746-d7dc100807bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:05.411762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2e46c-31e0-406c-8e9c-99e994b85704 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.443320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 163/309] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:05.444227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a68094-e7fb-4783-a746-d7dc100807bb None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.491859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4291f87-77ba-4665-b3d0-bf0c4474f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.492841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4291f87-77ba-4665-b3d0-bf0c4474f647 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.493125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4291f87-77ba-4665-b3d0-bf0c4474f647 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.493923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4291f87-77ba-4665-b3d0-bf0c4474f647 None admin] PATH_INFO: `/v3/users/0ef93d8bb6c644eb95042519a1038b2b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.495720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4291f87-77ba-4665-b3d0-bf0c4474f647 None admin] RBAC: Authorizing `identity:get_user(user_id=0ef93d8bb6c644eb95042519a1038b2b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:05.497592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4291f87-77ba-4665-b3d0-bf0c4474f647 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:05.506426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 147/310] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/users/0ef93d8bb6c644eb95042519a1038b2b => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:05.506426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4291f87-77ba-4665-b3d0-bf0c4474f647 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.508019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.562434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a68094-e7fb-4783-a746-d7dc100807bb None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.577517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.599786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.600674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.601123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.601546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.602563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] RBAC: Adding query filter params (role.id=2213bb7bedd24e0799c92509145673ee, user.id=c389c4e0f0ee4c02b1324b1fcae9e7cc, scope.system=all) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:05.602939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:05.604455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:05.618151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 164/311] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/role_assignments?user.id=c389c4e0f0ee4c02b1324b1fcae9e7cc&scope.system=all&role.id=2213bb7bedd24e0799c92509145673ee => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:05.618151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.635408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4291f87-77ba-4665-b3d0-bf0c4474f647 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.694558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b896-4088-42d8-ab3e-e442c0d3c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.695388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b896-4088-42d8-ab3e-e442c0d3c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.695679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b896-4088-42d8-ab3e-e442c0d3c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.695956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b896-4088-42d8-ab3e-e442c0d3c7f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.711615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44b896-4088-42d8-ab3e-e442c0d3c7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-1c44b896-4088-42d8-ab3e-e442c0d3c7f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:05.720492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:05.721521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:05.722366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 148/312] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:05.730242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b896-4088-42d8-ab3e-e442c0d3c7f8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.754092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f443170-cd29-456f-8187-068d18b04c6c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.772570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.817260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375f35-95d0-4023-9bf3-3076cf009dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.818477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375f35-95d0-4023-9bf3-3076cf009dfa None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.818764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375f35-95d0-4023-9bf3-3076cf009dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.819301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375f35-95d0-4023-9bf3-3076cf009dfa None admin] PATH_INFO: `/v3/system/users/0ef93d8bb6c644eb95042519a1038b2b/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.822197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9375f35-95d0-4023-9bf3-3076cf009dfa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ef93d8bb6c644eb95042519a1038b2b, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:05.824338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9375f35-95d0-4023-9bf3-3076cf009dfa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:05.869360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b896-4088-42d8-ab3e-e442c0d3c7f8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.887258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 165/313] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Jul 11 14:33:05 2022] PUT /identity/v3/system/users/0ef93d8bb6c644eb95042519a1038b2b/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:05.898895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.913012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.913819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.914231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.914521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.915393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:05.915712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:05.917259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:05.928961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 149/314] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:05.934664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375f35-95d0-4023-9bf3-3076cf009dfa None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:06.063677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375f35-95d0-4023-9bf3-3076cf009dfa None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:06.103663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fed-4fe2-4048-b84e-dffc6c810fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:06.104575 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fed-4fe2-4048-b84e-dffc6c810fc9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:06.104864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fed-4fe2-4048-b84e-dffc6c810fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:06.105146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fed-4fe2-4048-b84e-dffc6c810fc9 None admin] PATH_INFO: `/v3/users/f6c5ad664c18427390716e30d7b2b069` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:06.106463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0fed-4fe2-4048-b84e-dffc6c810fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5ad664c18427390716e30d7b2b069)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:06.107921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0fed-4fe2-4048-b84e-dffc6c810fc9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:06.109979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 166/315] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/users/f6c5ad664c18427390716e30d7b2b069 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:06.115176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:06.230879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d918-f33a-48e8-8cf7-fdb31bf04829 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:06.268352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ca1bb-dac7-4bf5-aa69-398cb279cae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:06.269373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca1bb-dac7-4bf5-aa69-398cb279cae7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:06.269884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca1bb-dac7-4bf5-aa69-398cb279cae7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:06.270410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca1bb-dac7-4bf5-aa69-398cb279cae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:06.330706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:06.345009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ca1bb-dac7-4bf5-aa69-398cb279cae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:06.346835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ca1bb-dac7-4bf5-aa69-398cb279cae7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:06.456421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 150/316] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:06.462478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fed-4fe2-4048-b84e-dffc6c810fc9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:06.511247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:06.574468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fed-4fe2-4048-b84e-dffc6c810fc9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:06.612025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c12f1-ff0f-4ead-80ff-27256774f3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:06.613269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c12f1-ff0f-4ead-80ff-27256774f3c1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:06.613773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c12f1-ff0f-4ead-80ff-27256774f3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:06.614297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c12f1-ff0f-4ead-80ff-27256774f3c1 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:06.615759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c12f1-ff0f-4ead-80ff-27256774f3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:06.617493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c12f1-ff0f-4ead-80ff-27256774f3c1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:06.620496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 167/317] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:06 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:06.626898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ca1bb-dac7-4bf5-aa69-398cb279cae7 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:06.718349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:06.736103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ca1bb-dac7-4bf5-aa69-398cb279cae7 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:06.772907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1b067-854c-4a49-8296-39944b5330d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:06.773501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1b067-854c-4a49-8296-39944b5330d2 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:06.773793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1b067-854c-4a49-8296-39944b5330d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:06.774077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1b067-854c-4a49-8296-39944b5330d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:06.775028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1b067-854c-4a49-8296-39944b5330d2 None admin] RBAC: Adding query filter params (role.id=2213bb7bedd24e0799c92509145673ee, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874, user.id=f6c5ad664c18427390716e30d7b2b069) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:06.775351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1b067-854c-4a49-8296-39944b5330d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:06.776819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1b067-854c-4a49-8296-39944b5330d2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:06.783687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 151/318] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:06 2022] GET /identity/v3/role_assignments?user.id=f6c5ad664c18427390716e30d7b2b069&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=2213bb7bedd24e0799c92509145673ee => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:07.053944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac3aa-4cae-40c3-9589-0f729cc25b68 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:07.053944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac3aa-4cae-40c3-9589-0f729cc25b68 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:07.053944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac3aa-4cae-40c3-9589-0f729cc25b68 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:07.053944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 168/319] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:07.055624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdfaa8-4a27-45f5-9872-c01b9dfbabb9 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:07.056489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdfaa8-4a27-45f5-9872-c01b9dfbabb9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:07.056773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdfaa8-4a27-45f5-9872-c01b9dfbabb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:07.075275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-28bdfaa8-4a27-45f5-9872-c01b9dfbabb9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:07.076594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-28bdfaa8-4a27-45f5-9872-c01b9dfbabb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:07.166427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 152/320] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:07.189262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac3aa-4cae-40c3-9589-0f729cc25b68 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:07.302731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac3aa-4cae-40c3-9589-0f729cc25b68 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:07.315092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:07.340332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58546-0a1c-4bb3-97d4-1ef0e1b6e07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:07.341398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58546-0a1c-4bb3-97d4-1ef0e1b6e07b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:07.341839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58546-0a1c-4bb3-97d4-1ef0e1b6e07b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:07.342283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58546-0a1c-4bb3-97d4-1ef0e1b6e07b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:07.343596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58546-0a1c-4bb3-97d4-1ef0e1b6e07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:07.345173 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58546-0a1c-4bb3-97d4-1ef0e1b6e07b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:07.347626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 169/321] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:07.353536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdfaa8-4a27-45f5-9872-c01b9dfbabb9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:07.450136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:07.472085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdfaa8-4a27-45f5-9872-c01b9dfbabb9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:07.514661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24ed3-8efe-429a-8463-3dcb995430d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:07.515344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24ed3-8efe-429a-8463-3dcb995430d2 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:07.515631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24ed3-8efe-429a-8463-3dcb995430d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:07.515910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24ed3-8efe-429a-8463-3dcb995430d2 None admin] PATH_INFO: `/v3/groups` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:07.516620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24ed3-8efe-429a-8463-3dcb995430d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:07.518139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24ed3-8efe-429a-8463-3dcb995430d2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:07.621839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 153/322] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Jul 11 14:33:07 2022] POST /identity/v3/groups => generated 226 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:07.848324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f229e-a5e0-424f-81ca-3efe2a6f7a2d None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:07.848649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f229e-a5e0-424f-81ca-3efe2a6f7a2d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:07.848889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f229e-a5e0-424f-81ca-3efe2a6f7a2d None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:07.850789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 170/323] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:07.856460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd2d43-43ab-4314-9c26-8adebc584023 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:07.856800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd2d43-43ab-4314-9c26-8adebc584023 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:07.857017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd2d43-43ab-4314-9c26-8adebc584023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:07.879479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7dbd2d43-43ab-4314-9c26-8adebc584023 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:07.880602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7dbd2d43-43ab-4314-9c26-8adebc584023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:07.970274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 154/324] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:07.994001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f229e-a5e0-424f-81ca-3efe2a6f7a2d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.029319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e19e8-2552-4b06-a613-2ac32fcc38f0 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.029319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e19e8-2552-4b06-a613-2ac32fcc38f0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.029319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e19e8-2552-4b06-a613-2ac32fcc38f0 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.029319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 155/325] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:08.034251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd424af8-28b6-4cce-bb48-515832bf90a1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.034541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd424af8-28b6-4cce-bb48-515832bf90a1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.034823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd424af8-28b6-4cce-bb48-515832bf90a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.054830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-bd424af8-28b6-4cce-bb48-515832bf90a1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:08.056200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bd424af8-28b6-4cce-bb48-515832bf90a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:08.128052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f229e-a5e0-424f-81ca-3efe2a6f7a2d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.132330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.139920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 156/326] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:08.166903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd424af8-28b6-4cce-bb48-515832bf90a1 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.183578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62158-45b5-4ffd-a494-5644a2201f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.184400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62158-45b5-4ffd-a494-5644a2201f4d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.184680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62158-45b5-4ffd-a494-5644a2201f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.184967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62158-45b5-4ffd-a494-5644a2201f4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.199464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b62158-45b5-4ffd-a494-5644a2201f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-39b62158-45b5-4ffd-a494-5644a2201f4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:08.209126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:08.210149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:08.211044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 171/327] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:08.218207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62158-45b5-4ffd-a494-5644a2201f4d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.320122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd424af8-28b6-4cce-bb48-515832bf90a1 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.320743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.372099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9262425-2269-480b-b7ff-cd69dacddd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.372099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262425-2269-480b-b7ff-cd69dacddd2c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.373340 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262425-2269-480b-b7ff-cd69dacddd2c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.373616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262425-2269-480b-b7ff-cd69dacddd2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.374864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62158-45b5-4ffd-a494-5644a2201f4d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.390232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9262425-2269-480b-b7ff-cd69dacddd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-f9262425-2269-480b-b7ff-cd69dacddd2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:08.400166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:08.408723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:08.409546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 157/328] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:08.415190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9262425-2269-480b-b7ff-cd69dacddd2c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.424083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.425041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.425597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.426043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.427021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:08.427521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:08.429660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:08.445004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 172/329] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:08.450729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.492688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.538816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9262425-2269-480b-b7ff-cd69dacddd2c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.558665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.563740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0ec3b-c631-446c-859c-e20d4edf2ba9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.578092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.578825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.579108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.579381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.580137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] RBAC: Adding query filter params (name=member) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:08.580438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:08.581843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:08.592021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 158/330] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:08.597612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.612746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d90d0-ef68-4e32-8666-83772172901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.613630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d90d0-ef68-4e32-8666-83772172901b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.613915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d90d0-ef68-4e32-8666-83772172901b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.614221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d90d0-ef68-4e32-8666-83772172901b None admin] PATH_INFO: `/v3/users/c389c4e0f0ee4c02b1324b1fcae9e7cc` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.615429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d90d0-ef68-4e32-8666-83772172901b None admin] RBAC: Authorizing `identity:get_user(user_id=c389c4e0f0ee4c02b1324b1fcae9e7cc)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:08.616886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d90d0-ef68-4e32-8666-83772172901b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:08.619424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 173/331] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:08 2022] GET /identity/v3/users/c389c4e0f0ee4c02b1324b1fcae9e7cc => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:08.624855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d90d0-ef68-4e32-8666-83772172901b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.708513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176926ab-dc4e-493b-b86b-bd1ed925004d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.732604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.751410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8f401-9cea-46b6-94cd-607632cbb9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.752539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8f401-9cea-46b6-94cd-607632cbb9b7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.752617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8f401-9cea-46b6-94cd-607632cbb9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.752834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8f401-9cea-46b6-94cd-607632cbb9b7 None admin] PATH_INFO: `/v3/users/0ef93d8bb6c644eb95042519a1038b2b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.754900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8f401-9cea-46b6-94cd-607632cbb9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=0ef93d8bb6c644eb95042519a1038b2b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:08.756349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8f401-9cea-46b6-94cd-607632cbb9b7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:08.758189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 159/332] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:08 2022] GET /identity/v3/users/0ef93d8bb6c644eb95042519a1038b2b => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:08.774134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8f401-9cea-46b6-94cd-607632cbb9b7 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.798355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d90d0-ef68-4e32-8666-83772172901b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.843869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f822-a797-4746-b871-36ef97630ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.844743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f822-a797-4746-b871-36ef97630ca5 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.845027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f822-a797-4746-b871-36ef97630ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.845301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f822-a797-4746-b871-36ef97630ca5 None admin] PATH_INFO: `/v3/system/users/c389c4e0f0ee4c02b1324b1fcae9e7cc/roles/2213bb7bedd24e0799c92509145673ee` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.846816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f822-a797-4746-b871-36ef97630ca5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c389c4e0f0ee4c02b1324b1fcae9e7cc, role_id=2213bb7bedd24e0799c92509145673ee)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:08.848902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f822-a797-4746-b871-36ef97630ca5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:08.913455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 174/333] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Jul 11 14:33:08 2022] PUT /identity/v3/system/users/c389c4e0f0ee4c02b1324b1fcae9e7cc/roles/2213bb7bedd24e0799c92509145673ee => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:08.936913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8f401-9cea-46b6-94cd-607632cbb9b7 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.978357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faec587-c1d2-495c-81f4-cd5d2e54050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.979060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faec587-c1d2-495c-81f4-cd5d2e54050f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.979352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faec587-c1d2-495c-81f4-cd5d2e54050f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.979674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faec587-c1d2-495c-81f4-cd5d2e54050f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.980596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faec587-c1d2-495c-81f4-cd5d2e54050f None admin] RBAC: Adding query filter params (role.id=20ef9cdb3c3c4a79bfacad902829d018, user.id=0ef93d8bb6c644eb95042519a1038b2b, scope.system=all) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:08.980964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faec587-c1d2-495c-81f4-cd5d2e54050f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:08.982479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faec587-c1d2-495c-81f4-cd5d2e54050f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:09.000297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 160/334] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Jul 11 14:33:08 2022] GET /identity/v3/role_assignments?user.id=0ef93d8bb6c644eb95042519a1038b2b&scope.system=all&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:10.412381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c9b0-f9b7-4091-b4a6-0a2ddd9164b4 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:10.412885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c9b0-f9b7-4091-b4a6-0a2ddd9164b4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:10.412992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c9b0-f9b7-4091-b4a6-0a2ddd9164b4 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:10.414672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 175/335] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:10.420681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2efb6-9b6e-4696-8306-01cb1ba1d9db None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:10.421544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2efb6-9b6e-4696-8306-01cb1ba1d9db None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:10.422017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2efb6-9b6e-4696-8306-01cb1ba1d9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:10.440453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-62a2efb6-9b6e-4696-8306-01cb1ba1d9db None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:10.441993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-62a2efb6-9b6e-4696-8306-01cb1ba1d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:10.495507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:10.523219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 161/336] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:10.548154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c9b0-f9b7-4091-b4a6-0a2ddd9164b4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:10.585028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:10.665861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c9b0-f9b7-4091-b4a6-0a2ddd9164b4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:10.712584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bac3e-071a-4e9d-a7f9-366fdcfaf263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:10.713392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bac3e-071a-4e9d-a7f9-366fdcfaf263 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:10.713676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bac3e-071a-4e9d-a7f9-366fdcfaf263 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:10.713942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bac3e-071a-4e9d-a7f9-366fdcfaf263 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:10.730957 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bac3e-071a-4e9d-a7f9-366fdcfaf263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-464bac3e-071a-4e9d-a7f9-366fdcfaf263 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:10.738754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:10.739672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:10.740610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 176/337] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:10.755260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2efb6-9b6e-4696-8306-01cb1ba1d9db None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:10.896228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2efb6-9b6e-4696-8306-01cb1ba1d9db None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:10.936049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490789a-8442-4f78-86e5-5c2bc6203278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:10.936637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490789a-8442-4f78-86e5-5c2bc6203278 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:10.936916 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490789a-8442-4f78-86e5-5c2bc6203278 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:10.937195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490789a-8442-4f78-86e5-5c2bc6203278 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:10.937934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490789a-8442-4f78-86e5-5c2bc6203278 None admin] RBAC: Adding query filter params (name=member) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:10.938259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490789a-8442-4f78-86e5-5c2bc6203278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:10.939629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490789a-8442-4f78-86e5-5c2bc6203278 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:10.956108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 162/338] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:10.961585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bac3e-071a-4e9d-a7f9-366fdcfaf263 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:11.092055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:11.100845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bac3e-071a-4e9d-a7f9-366fdcfaf263 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:11.142531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27508545-dcc2-4098-9200-9b1f4d5e1d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:11.143187 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27508545-dcc2-4098-9200-9b1f4d5e1d8e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.143475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27508545-dcc2-4098-9200-9b1f4d5e1d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.143753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27508545-dcc2-4098-9200-9b1f4d5e1d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.224001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27508545-dcc2-4098-9200-9b1f4d5e1d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:11.225398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27508545-dcc2-4098-9200-9b1f4d5e1d8e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:11.243015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4863-9cad-41e0-9d92-b04083ce55c4 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.243333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4863-9cad-41e0-9d92-b04083ce55c4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.243619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4863-9cad-41e0-9d92-b04083ce55c4 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.246406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 163/339] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:11.250662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccdace-5b28-49a8-a79e-72363450d790 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.250952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccdace-5b28-49a8-a79e-72363450d790 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.251235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccdace-5b28-49a8-a79e-72363450d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.275521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-37ccdace-5b28-49a8-a79e-72363450d790 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:11.276728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-37ccdace-5b28-49a8-a79e-72363450d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:11.332745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:11.362134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:11.362733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 177/340] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:11.364392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27508545-dcc2-4098-9200-9b1f4d5e1d8e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:11.385417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 164/341] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:11.402175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f54a8-3c0c-4a41-ad8b-8a99e3012c89 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.402490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f54a8-3c0c-4a41-ad8b-8a99e3012c89 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.402913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f54a8-3c0c-4a41-ad8b-8a99e3012c89 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.410207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 165/342] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:11.416042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4186-5be3-4e6b-93e5-76c3f940fdf7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.422263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4186-5be3-4e6b-93e5-76c3f940fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.422263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4186-5be3-4e6b-93e5-76c3f940fdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.449183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7a2f4186-5be3-4e6b-93e5-76c3f940fdf7 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:11.450405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7a2f4186-5be3-4e6b-93e5-76c3f940fdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:11.534309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27508545-dcc2-4098-9200-9b1f4d5e1d8e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:11.550134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 166/343] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:11.551066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f4186-5be3-4e6b-93e5-76c3f940fdf7 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:11.604000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56eb57-137f-40c0-9003-a4e41a03c9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:11.604881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56eb57-137f-40c0-9003-a4e41a03c9bd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.605222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56eb57-137f-40c0-9003-a4e41a03c9bd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.605509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56eb57-137f-40c0-9003-a4e41a03c9bd None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.606776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56eb57-137f-40c0-9003-a4e41a03c9bd None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:11.608244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56eb57-137f-40c0-9003-a4e41a03c9bd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:11.614483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 178/344] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:11 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:11.615319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56eb57-137f-40c0-9003-a4e41a03c9bd None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:11.664516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:11.667849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f4186-5be3-4e6b-93e5-76c3f940fdf7 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:11.716255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11df28-9368-4cc8-9fd3-2b5283436d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:11.717072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11df28-9368-4cc8-9fd3-2b5283436d5f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.717354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11df28-9368-4cc8-9fd3-2b5283436d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.717629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11df28-9368-4cc8-9fd3-2b5283436d5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.737113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11df28-9368-4cc8-9fd3-2b5283436d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-1c11df28-9368-4cc8-9fd3-2b5283436d5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:11.745213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:11.746196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:11.747508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:11.748656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 167/345] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:11.750019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11df28-9368-4cc8-9fd3-2b5283436d5f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:11.757550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:11.826972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56eb57-137f-40c0-9003-a4e41a03c9bd None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:11.891340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9a79-bd99-420e-96ee-b7a5bf70f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:11.892159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9a79-bd99-420e-96ee-b7a5bf70f4cf None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.892441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9a79-bd99-420e-96ee-b7a5bf70f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.892706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9a79-bd99-420e-96ee-b7a5bf70f4cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.912828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f9a79-bd99-420e-96ee-b7a5bf70f4cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-b10f9a79-bd99-420e-96ee-b7a5bf70f4cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:11.922953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:11.924019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:11.924859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 179/346] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:33:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:11.925538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9a79-bd99-420e-96ee-b7a5bf70f4cf None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:11.941910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11df28-9368-4cc8-9fd3-2b5283436d5f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:12.012183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796c00-7a5b-42d1-91d1-80dbdd454885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:12.013058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796c00-7a5b-42d1-91d1-80dbdd454885 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.013340 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796c00-7a5b-42d1-91d1-80dbdd454885 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.013614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796c00-7a5b-42d1-91d1-80dbdd454885 None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.027723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07796c00-7a5b-42d1-91d1-80dbdd454885 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:12.029207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07796c00-7a5b-42d1-91d1-80dbdd454885 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:12.031761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 168/347] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:11 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:12.032562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796c00-7a5b-42d1-91d1-80dbdd454885 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:12.084332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.113365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9a79-bd99-420e-96ee-b7a5bf70f4cf None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:12.147107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.166839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:12.167927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.168388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.168693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.169752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:12.170074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:12.171927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:12.186027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 180/348] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:12.187436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:12.204543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796c00-7a5b-42d1-91d1-80dbdd454885 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:12.247934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf945d-60f4-41cd-85ee-0346ce876ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:12.248609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf945d-60f4-41cd-85ee-0346ce876ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.248893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf945d-60f4-41cd-85ee-0346ce876ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.249172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf945d-60f4-41cd-85ee-0346ce876ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.249934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf945d-60f4-41cd-85ee-0346ce876ed9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:12.250271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf945d-60f4-41cd-85ee-0346ce876ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:12.251663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf945d-60f4-41cd-85ee-0346ce876ed9 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:12.267189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 169/349] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:12.268649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a2a5-07d1-4e32-8b44-8aa57177f9e3 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.271156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a2a5-07d1-4e32-8b44-8aa57177f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.271156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a2a5-07d1-4e32-8b44-8aa57177f9e3 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.272792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 170/350] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:12.273563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3a2a5-07d1-4e32-8b44-8aa57177f9e3 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:12.341337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d74c4-e1de-4beb-9ace-e2d737a2b8aa None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:12.391160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.399720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:12.400437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.400728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.401030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.403346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] RBAC: Adding query filter params (group.id=8fd5bf71a5b247f7a355fb6a4fc811c1, role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:12.403346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:12.403920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:12.410158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 181/351] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:12 2022] GET /identity/v3/role_assignments?group.id=8fd5bf71a5b247f7a355fb6a4fc811c1&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:12.410978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:12.411552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3a2a5-07d1-4e32-8b44-8aa57177f9e3 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:12.463706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc235248-39f3-44b7-af06-fc760a8f8bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:12.464460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc235248-39f3-44b7-af06-fc760a8f8bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.464714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc235248-39f3-44b7-af06-fc760a8f8bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.464991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc235248-39f3-44b7-af06-fc760a8f8bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.480893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.548895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1a79d-e23e-4f75-aa16-ec7a1dc1c5b5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:12.559394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc235248-39f3-44b7-af06-fc760a8f8bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:12.561583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc235248-39f3-44b7-af06-fc760a8f8bc3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:12.592199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f0503-1c5f-4d5f-9e84-ba852aecade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:12.592781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0503-1c5f-4d5f-9e84-ba852aecade8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.595310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0503-1c5f-4d5f-9e84-ba852aecade8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.595594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0503-1c5f-4d5f-9e84-ba852aecade8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.670257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.690547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 171/352] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:12.691828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee21e03-5c7f-4edd-81cc-336d0e52d6ec None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.692122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee21e03-5c7f-4edd-81cc-336d0e52d6ec None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.692401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee21e03-5c7f-4edd-81cc-336d0e52d6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.701890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f0503-1c5f-4d5f-9e84-ba852aecade8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:12.703428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f0503-1c5f-4d5f-9e84-ba852aecade8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:12.712807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-8ee21e03-5c7f-4edd-81cc-336d0e52d6ec None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:12.713995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-8ee21e03-5c7f-4edd-81cc-336d0e52d6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:12.772766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.793400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 172/353] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:12.794765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a2f3-9412-4d4e-a64f-633fda5b576f None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.795053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a2f3-9412-4d4e-a64f-633fda5b576f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.795332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a2f3-9412-4d4e-a64f-633fda5b576f None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.796852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 173/354] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:12.797557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483a2f3-9412-4d4e-a64f-633fda5b576f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:12.839808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 182/355] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:12.841074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f4d94-7060-4c9b-b088-14a9e9773300 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.841373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f4d94-7060-4c9b-b088-14a9e9773300 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.841655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f4d94-7060-4c9b-b088-14a9e9773300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.860410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-dc1f4d94-7060-4c9b-b088-14a9e9773300 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:12.861644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-dc1f4d94-7060-4c9b-b088-14a9e9773300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:12.914430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483a2f3-9412-4d4e-a64f-633fda5b576f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:12.939371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.948704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 183/356] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:12.949390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f4d94-7060-4c9b-b088-14a9e9773300 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:12.973616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2944921-959c-46b2-81b7-affdde97d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:12.975054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2944921-959c-46b2-81b7-affdde97d340 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.975782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2944921-959c-46b2-81b7-affdde97d340 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.976258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2944921-959c-46b2-81b7-affdde97d340 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.977773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2944921-959c-46b2-81b7-affdde97d340 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:12.979745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2944921-959c-46b2-81b7-affdde97d340 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:12.982229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 174/357] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:12 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:12.983357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2944921-959c-46b2-81b7-affdde97d340 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.052050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:13.089996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f4d94-7060-4c9b-b088-14a9e9773300 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.117157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2944921-959c-46b2-81b7-affdde97d340 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.134723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d29057-1a9c-4d98-ae2d-824b468fdd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.135659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d29057-1a9c-4d98-ae2d-824b468fdd76 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.135952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d29057-1a9c-4d98-ae2d-824b468fdd76 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.136292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d29057-1a9c-4d98-ae2d-824b468fdd76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.150423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d29057-1a9c-4d98-ae2d-824b468fdd76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-88d29057-1a9c-4d98-ae2d-824b468fdd76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:13.158341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:13.159286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:13.161044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 184/358] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:13.162044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c6f62-4590-42d0-8342-b575cf9a627d None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.162044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c6f62-4590-42d0-8342-b575cf9a627d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.163029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c6f62-4590-42d0-8342-b575cf9a627d None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.164363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 185/359] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:13.165607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c6f62-4590-42d0-8342-b575cf9a627d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.174315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb700-af5e-4be6-a02f-4160b2dceb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.175507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb700-af5e-4be6-a02f-4160b2dceb7c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.175968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb700-af5e-4be6-a02f-4160b2dceb7c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.176943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb700-af5e-4be6-a02f-4160b2dceb7c None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.178853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bb700-af5e-4be6-a02f-4160b2dceb7c None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:13.180612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bb700-af5e-4be6-a02f-4160b2dceb7c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:13.183863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 175/360] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:12 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:13.185146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb700-af5e-4be6-a02f-4160b2dceb7c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.255220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:13.296522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c6f62-4590-42d0-8342-b575cf9a627d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.321831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb700-af5e-4be6-a02f-4160b2dceb7c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.342393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaaf06-7635-49a7-add0-de147124223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.343314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaf06-7635-49a7-add0-de147124223d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.343603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaf06-7635-49a7-add0-de147124223d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.343873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaf06-7635-49a7-add0-de147124223d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.348150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:13.360617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaaf06-7635-49a7-add0-de147124223d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:13.360875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6475-9ae8-4683-8dcc-c1880aa977a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.361697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6475-9ae8-4683-8dcc-c1880aa977a8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.361978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6475-9ae8-4683-8dcc-c1880aa977a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.364156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6475-9ae8-4683-8dcc-c1880aa977a8 None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.364156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6475-9ae8-4683-8dcc-c1880aa977a8 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:13.364960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6475-9ae8-4683-8dcc-c1880aa977a8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:13.366829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 176/361] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:13.367822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c2ca4-f7cf-4420-8d5f-b639100fb02a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.368054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c2ca4-f7cf-4420-8d5f-b639100fb02a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.369064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c2ca4-f7cf-4420-8d5f-b639100fb02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-7bbaaf06-7635-49a7-add0-de147124223d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:13.371514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:13.372432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:13.373697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 186/362] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:13.374604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaaf06-7635-49a7-add0-de147124223d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.389909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-977c2ca4-f7cf-4420-8d5f-b639100fb02a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:13.391662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-977c2ca4-f7cf-4420-8d5f-b639100fb02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:13.486054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 177/363] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:13.487171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c2ca4-f7cf-4420-8d5f-b639100fb02a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.514827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaaf06-7635-49a7-add0-de147124223d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.545337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:13.556595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.557271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.565890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.565890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.565890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:13.565890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:13.565890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:13.571945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 187/364] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:13.573912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.613580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c2ca4-f7cf-4420-8d5f-b639100fb02a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.645613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:13.672372 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7401e-c350-4852-bb6b-b3b255366825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.673258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7401e-c350-4852-bb6b-b3b255366825 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.673543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7401e-c350-4852-bb6b-b3b255366825 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.673820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7401e-c350-4852-bb6b-b3b255366825 None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.675056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7401e-c350-4852-bb6b-b3b255366825 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:13.676500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7401e-c350-4852-bb6b-b3b255366825 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:13.678168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 178/365] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:13.680059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7401e-c350-4852-bb6b-b3b255366825 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.707166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17af5a-a895-495d-a679-1948486b8bc8 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.769126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.769832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.770800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.770800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.771514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] RBAC: Adding query filter params (group.id=8fd5bf71a5b247f7a355fb6a4fc811c1, role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:13.771728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:13.774039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:13.780446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 188/366] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/role_assignments?group.id=8fd5bf71a5b247f7a355fb6a4fc811c1&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:13.781073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.831711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7401e-c350-4852-bb6b-b3b255366825 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.856665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:13.877273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5087300-d128-4c10-8263-c1373249916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.877964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5087300-d128-4c10-8263-c1373249916f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.878289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5087300-d128-4c10-8263-c1373249916f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.878567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5087300-d128-4c10-8263-c1373249916f None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.879354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5087300-d128-4c10-8263-c1373249916f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:13.879667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5087300-d128-4c10-8263-c1373249916f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:13.881198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5087300-d128-4c10-8263-c1373249916f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:13.891628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 179/367] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:13.898016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5087300-d128-4c10-8263-c1373249916f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.944237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c4bb-8d8d-4a54-8738-b00cf52a3db4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:13.985365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:13.995132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6c39e-cb4a-4a77-9f6d-0add6fdf9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:13.996354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6c39e-cb4a-4a77-9f6d-0add6fdf9d74 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.996644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6c39e-cb4a-4a77-9f6d-0add6fdf9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.996922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6c39e-cb4a-4a77-9f6d-0add6fdf9d74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.013337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6c39e-cb4a-4a77-9f6d-0add6fdf9d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-d8d6c39e-cb4a-4a77-9f6d-0add6fdf9d74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:14.024073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:14.026404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:14.027318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 189/368] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:14.028877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6c39e-cb4a-4a77-9f6d-0add6fdf9d74 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.030074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5087300-d128-4c10-8263-c1373249916f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.078689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8512a-a126-4fea-8061-f37a1805b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.079993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8512a-a126-4fea-8061-f37a1805b5b4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.080486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8512a-a126-4fea-8061-f37a1805b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.081019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8512a-a126-4fea-8061-f37a1805b5b4 None admin] PATH_INFO: `/v3/users/c389c4e0f0ee4c02b1324b1fcae9e7cc` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.083163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8512a-a126-4fea-8061-f37a1805b5b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c389c4e0f0ee4c02b1324b1fcae9e7cc)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.084921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8512a-a126-4fea-8061-f37a1805b5b4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.088511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 180/369] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/users/c389c4e0f0ee4c02b1324b1fcae9e7cc => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:14.090139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8512a-a126-4fea-8061-f37a1805b5b4 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.161663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.179303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6c39e-cb4a-4a77-9f6d-0add6fdf9d74 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.227094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.228416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.228940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.229464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.230441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] RBAC: Adding query filter params (group.id=8fd5bf71a5b247f7a355fb6a4fc811c1, role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:14.230861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.232160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8512a-a126-4fea-8061-f37a1805b5b4 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.232510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.240589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 190/370] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/role_assignments?group.id=8fd5bf71a5b247f7a355fb6a4fc811c1&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:14.241550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.281925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776ea7-e501-4563-b422-333e5e3167e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.282890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776ea7-e501-4563-b422-333e5e3167e0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.283377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776ea7-e501-4563-b422-333e5e3167e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.283846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776ea7-e501-4563-b422-333e5e3167e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.310206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.371577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2776ea7-e501-4563-b422-333e5e3167e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.373509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2776ea7-e501-4563-b422-333e5e3167e0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.391245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8767226-5989-4ee6-9b47-a7f7ab89a5f7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.433766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.434842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.435378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.435930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.436918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:14.437441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.439086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.440996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.449395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 191/371] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:14.453442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.513882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 181/372] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:14.517589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776ea7-e501-4563-b422-333e5e3167e0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.591220 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e621-bf4a-41d1-a6d2-0b5c6e4ee1a5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.603861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.646137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.646137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.646137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.646137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.646569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] RBAC: Adding query filter params (role.id=2213bb7bedd24e0799c92509145673ee, user.id=c389c4e0f0ee4c02b1324b1fcae9e7cc, scope.system=all) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:14.646569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.647544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.660276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776ea7-e501-4563-b422-333e5e3167e0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.662339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 192/373] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/role_assignments?user.id=c389c4e0f0ee4c02b1324b1fcae9e7cc&scope.system=all&role.id=2213bb7bedd24e0799c92509145673ee => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:14.663354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.742147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b606c7-cdfd-446a-bda3-9b76be278bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.742147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b606c7-cdfd-446a-bda3-9b76be278bbf None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.742147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b606c7-cdfd-446a-bda3-9b76be278bbf None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.742147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b606c7-cdfd-446a-bda3-9b76be278bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.780601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.900762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b606c7-cdfd-446a-bda3-9b76be278bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.901765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833fa6-a04d-4fd0-9aee-3cee2758d77e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.902264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b606c7-cdfd-446a-bda3-9b76be278bbf None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.950790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc18b0e-ffcb-4930-bc14-1d40a34ed750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.952152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc18b0e-ffcb-4930-bc14-1d40a34ed750 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.952640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc18b0e-ffcb-4930-bc14-1d40a34ed750 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.953124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc18b0e-ffcb-4930-bc14-1d40a34ed750 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.954715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc18b0e-ffcb-4930-bc14-1d40a34ed750 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.956468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc18b0e-ffcb-4930-bc14-1d40a34ed750 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.958860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 193/374] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:14.960284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d704ad-0b26-41ee-87b8-ce007fc23636 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.960877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d704ad-0b26-41ee-87b8-ce007fc23636 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.961361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d704ad-0b26-41ee-87b8-ce007fc23636 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.967687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 194/375] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:14.969824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d704ad-0b26-41ee-87b8-ce007fc23636 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.010605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 182/376] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:15.011866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb9f56-157f-476a-a8b0-fc507a3a6ad9 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.012245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb9f56-157f-476a-a8b0-fc507a3a6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.012531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb9f56-157f-476a-a8b0-fc507a3a6ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.015637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.032531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-60cb9f56-157f-476a-a8b0-fc507a3a6ad9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:15.033732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-60cb9f56-157f-476a-a8b0-fc507a3a6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:15.084447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.094788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d704ad-0b26-41ee-87b8-ce007fc23636 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.116463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 183/377] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:15.116463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb9f56-157f-476a-a8b0-fc507a3a6ad9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.148215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95037c-f4d1-4dc9-aaf8-92bf612c433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.149946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95037c-f4d1-4dc9-aaf8-92bf612c433c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.150438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95037c-f4d1-4dc9-aaf8-92bf612c433c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.150914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95037c-f4d1-4dc9-aaf8-92bf612c433c None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.152405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95037c-f4d1-4dc9-aaf8-92bf612c433c None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.154198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95037c-f4d1-4dc9-aaf8-92bf612c433c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.156333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 195/378] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:15.161993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95037c-f4d1-4dc9-aaf8-92bf612c433c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.226484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb9f56-157f-476a-a8b0-fc507a3a6ad9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.268321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc01006-e866-47c1-8636-8e23455e3616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.269167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01006-e866-47c1-8636-8e23455e3616 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.269459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01006-e866-47c1-8636-8e23455e3616 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.269738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01006-e866-47c1-8636-8e23455e3616 None admin] PATH_INFO: `/v3/projects/6d6ad6c08bb2467485d9a32d65d47482` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.271092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc01006-e866-47c1-8636-8e23455e3616 None admin] RBAC: Authorizing `identity:get_project(project_id=6d6ad6c08bb2467485d9a32d65d47482)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.273453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc01006-e866-47c1-8636-8e23455e3616 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.276271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 184/379] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/projects/6d6ad6c08bb2467485d9a32d65d47482 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:15.277070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc01006-e866-47c1-8636-8e23455e3616 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.283918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95037c-f4d1-4dc9-aaf8-92bf612c433c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.285806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.324769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6fd04-58db-4b17-b6a4-48d96c122ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.325961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6fd04-58db-4b17-b6a4-48d96c122ce5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.326446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6fd04-58db-4b17-b6a4-48d96c122ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.326916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6fd04-58db-4b17-b6a4-48d96c122ce5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.331622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.340211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6fd04-58db-4b17-b6a4-48d96c122ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-1ff6fd04-58db-4b17-b6a4-48d96c122ce5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:15.348436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:15.350217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:15.351041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:15.353162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 196/380] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:15.354213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6fd04-58db-4b17-b6a4-48d96c122ce5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.392018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc01006-e866-47c1-8636-8e23455e3616 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.429022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.429692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.429980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.430296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.431179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] RBAC: Adding query filter params (group.id=8fd5bf71a5b247f7a355fb6a4fc811c1, role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:15.431499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.432950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.439282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 185/381] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/role_assignments?group.id=8fd5bf71a5b247f7a355fb6a4fc811c1&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:15.440089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.484662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6fd04-58db-4b17-b6a4-48d96c122ce5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.538073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c28a39-8315-4e93-84a6-256d09466935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.539339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c28a39-8315-4e93-84a6-256d09466935 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.539832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c28a39-8315-4e93-84a6-256d09466935 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.540337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c28a39-8315-4e93-84a6-256d09466935 None admin] PATH_INFO: `/v3/groups/7b96375d6fbe4d1b9ed22d70097b5f95` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.547724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c28a39-8315-4e93-84a6-256d09466935 None admin] RBAC: Authorizing `identity:get_group(group_id=7b96375d6fbe4d1b9ed22d70097b5f95)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.549618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c28a39-8315-4e93-84a6-256d09466935 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.551685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 197/382] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/groups/7b96375d6fbe4d1b9ed22d70097b5f95 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:15.556986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c5c6-5578-4864-b1d1-b182cfcc3845 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.558777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c28a39-8315-4e93-84a6-256d09466935 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.565151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.594915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.595730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.596075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.596361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.597177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] RBAC: Adding query filter params (name=member) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:15.597493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.602124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.606306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.609563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 186/383] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:15.614813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.717951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c28a39-8315-4e93-84a6-256d09466935 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.734134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cb679-20ce-4623-9c3d-38a4fb660563 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.772174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.773311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.776440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.777099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.778228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] RBAC: Adding query filter params (group.id=7b96375d6fbe4d1b9ed22d70097b5f95, role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=6d6ad6c08bb2467485d9a32d65d47482) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:15.778897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.780702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.782260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038894b8-c8b3-4067-b3c5-0d1c2ac72e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.783239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038894b8-c8b3-4067-b3c5-0d1c2ac72e3f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.783683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038894b8-c8b3-4067-b3c5-0d1c2ac72e3f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.783944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038894b8-c8b3-4067-b3c5-0d1c2ac72e3f None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.785635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038894b8-c8b3-4067-b3c5-0d1c2ac72e3f None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.787040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038894b8-c8b3-4067-b3c5-0d1c2ac72e3f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.791725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 198/385] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/role_assignments?group.id=7b96375d6fbe4d1b9ed22d70097b5f95&scope.project.id=6d6ad6c08bb2467485d9a32d65d47482&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:15.791855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 187/385] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:15.799078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038894b8-c8b3-4067-b3c5-0d1c2ac72e3f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.879187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.937283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038894b8-c8b3-4067-b3c5-0d1c2ac72e3f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.979871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bdb89-5bac-409b-8309-62aa029c2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.980768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdb89-5bac-409b-8309-62aa029c2718 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.981057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdb89-5bac-409b-8309-62aa029c2718 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.981337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdb89-5bac-409b-8309-62aa029c2718 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.983240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bdb89-5bac-409b-8309-62aa029c2718 None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.984687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bdb89-5bac-409b-8309-62aa029c2718 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.986813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 188/386] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:15.992682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:16.119090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:16.131884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234dbe8-e9e5-467f-84c0-7a20b97fe36a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:16.173148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c17a93-f3e6-415f-8b2b-bd717441bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:16.174043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c17a93-f3e6-415f-8b2b-bd717441bd30 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.174370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c17a93-f3e6-415f-8b2b-bd717441bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.174654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c17a93-f3e6-415f-8b2b-bd717441bd30 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/groups/8fd5bf71a5b247f7a355fb6a4fc811c1/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.176657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c17a93-f3e6-415f-8b2b-bd717441bd30 None admin] RBAC: Authorizing `identity:create_grant(project_id=efca54e53d414d1c9c96a76b5d58a31b, group_id=8fd5bf71a5b247f7a355fb6a4fc811c1, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:16.178120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c17a93-f3e6-415f-8b2b-bd717441bd30 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:16.267544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 199/387] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Jul 11 14:33:15 2022] PUT /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/groups/8fd5bf71a5b247f7a355fb6a4fc811c1/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:16.477096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44277223-80b3-4b09-8805-2e16b876b3b4 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.477450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44277223-80b3-4b09-8805-2e16b876b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.478338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44277223-80b3-4b09-8805-2e16b876b3b4 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.480097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 189/388] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:16.486346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227e92-47f1-421d-95f6-3558cac8cdd6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.486677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227e92-47f1-421d-95f6-3558cac8cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.486927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227e92-47f1-421d-95f6-3558cac8cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.511271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e8227e92-47f1-421d-95f6-3558cac8cdd6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:16.512527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e8227e92-47f1-421d-95f6-3558cac8cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:16.602206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 200/389] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:16.621179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44277223-80b3-4b09-8805-2e16b876b3b4 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:16.752272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44277223-80b3-4b09-8805-2e16b876b3b4 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:16.762802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:16.793320 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6e454-674f-4722-8d86-3d7717707326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:16.794920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e454-674f-4722-8d86-3d7717707326 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.794920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e454-674f-4722-8d86-3d7717707326 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.794920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e454-674f-4722-8d86-3d7717707326 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.806699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6e454-674f-4722-8d86-3d7717707326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-3af6e454-674f-4722-8d86-3d7717707326 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:16.817404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:16.818573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:16.819588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:16.825114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 190/390] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:16.828838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8227e92-47f1-421d-95f6-3558cac8cdd6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:16.912129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371552-eef2-40f1-aa31-86786b897691 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.912489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371552-eef2-40f1-aa31-86786b897691 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.912690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371552-eef2-40f1-aa31-86786b897691 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.915003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 191/391] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:16.928728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883b5d9-b313-494c-bf93-173195786dd5 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.929033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883b5d9-b313-494c-bf93-173195786dd5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.929288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883b5d9-b313-494c-bf93-173195786dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.965304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-e883b5d9-b313-494c-bf93-173195786dd5 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:16.966910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e883b5d9-b313-494c-bf93-173195786dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:16.978488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:17.011518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8227e92-47f1-421d-95f6-3558cac8cdd6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:17.080065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:17.081208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.081697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.082202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.083276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:17.084463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:17.086262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:17.102379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 201/392] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:17.104752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 192/393] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:17.111116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:17.163168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883b5d9-b313-494c-bf93-173195786dd5 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:17.294308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e821-cc2b-4482-bc84-81c890f8367c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:17.349820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:17.355603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883b5d9-b313-494c-bf93-173195786dd5 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:17.373031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b4b26-e896-4e8b-9e5c-c82325149b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:17.374304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4b26-e896-4e8b-9e5c-c82325149b12 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.374813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4b26-e896-4e8b-9e5c-c82325149b12 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.375308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4b26-e896-4e8b-9e5c-c82325149b12 None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.378038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b4b26-e896-4e8b-9e5c-c82325149b12 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:17.379763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b4b26-e896-4e8b-9e5c-c82325149b12 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:17.383104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 202/394] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:17 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:17.387926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b4b26-e896-4e8b-9e5c-c82325149b12 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:17.411230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:17.434725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863c0b-923b-4f71-a30f-0ee063fa16dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:17.435859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863c0b-923b-4f71-a30f-0ee063fa16dc None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.436316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863c0b-923b-4f71-a30f-0ee063fa16dc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.436764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863c0b-923b-4f71-a30f-0ee063fa16dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.456502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91863c0b-923b-4f71-a30f-0ee063fa16dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-91863c0b-923b-4f71-a30f-0ee063fa16dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:17.465729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:17.466691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:17.467588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:17.470173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 193/395] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:33:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:17.476195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863c0b-923b-4f71-a30f-0ee063fa16dc None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:17.575854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b4b26-e896-4e8b-9e5c-c82325149b12 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:17.617877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad31b-33f6-4427-a362-a68700104ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:17.619660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad31b-33f6-4427-a362-a68700104ee2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.620179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad31b-33f6-4427-a362-a68700104ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.620706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad31b-33f6-4427-a362-a68700104ee2 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.622631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ad31b-33f6-4427-a362-a68700104ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:17.624321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ad31b-33f6-4427-a362-a68700104ee2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:17.626440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 203/396] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:17 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:17.632129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad31b-33f6-4427-a362-a68700104ee2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:17.669800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863c0b-923b-4f71-a30f-0ee063fa16dc None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:17.724553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:17.725588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.726069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.726615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.728660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:17.729226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:17.730834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:17.740500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 194/397] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:17.746902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:17.763750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:17.772172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:17.813712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad31b-33f6-4427-a362-a68700104ee2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:17.871103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0db38-8b3f-462d-872a-c4cb211f886d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:17.900262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c2105-8539-4d59-a7f9-2a929f31a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:17.901162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c2105-8539-4d59-a7f9-2a929f31a3c2 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.901449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c2105-8539-4d59-a7f9-2a929f31a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.901769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c2105-8539-4d59-a7f9-2a929f31a3c2 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/groups/8fd5bf71a5b247f7a355fb6a4fc811c1/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.906653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c2105-8539-4d59-a7f9-2a929f31a3c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=60578e3e4a6e4935acb2a38bab0ac874, group_id=8fd5bf71a5b247f7a355fb6a4fc811c1, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:17.908206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c2105-8539-4d59-a7f9-2a929f31a3c2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:17.909453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb668919-d7f2-4756-916c-ec7a80fb6358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:17.910593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668919-d7f2-4756-916c-ec7a80fb6358 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.911081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668919-d7f2-4756-916c-ec7a80fb6358 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.911566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668919-d7f2-4756-916c-ec7a80fb6358 None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.914847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb668919-d7f2-4756-916c-ec7a80fb6358 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:17.917864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb668919-d7f2-4756-916c-ec7a80fb6358 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:17.920654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 195/398] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:17 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:17.926082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb668919-d7f2-4756-916c-ec7a80fb6358 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.021394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 204/399] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Jul 11 14:33:17 2022] PUT /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/groups/8fd5bf71a5b247f7a355fb6a4fc811c1/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:33:18.029913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:18.045337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb668919-d7f2-4756-916c-ec7a80fb6358 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:18.084169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bf862-13ca-4ede-992e-57d2a42908fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:18.085439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf862-13ca-4ede-992e-57d2a42908fb None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.085959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf862-13ca-4ede-992e-57d2a42908fb None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.086448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf862-13ca-4ede-992e-57d2a42908fb None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.088504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bf862-13ca-4ede-992e-57d2a42908fb None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:18.090274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bf862-13ca-4ede-992e-57d2a42908fb None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:18.092490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 196/400] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:17 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:18.098568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c2105-8539-4d59-a7f9-2a929f31a3c2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.241929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c2105-8539-4d59-a7f9-2a929f31a3c2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:18.286602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0b42a-40c1-4cc2-a0ee-c3cf695fa26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:18.287565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b42a-40c1-4cc2-a0ee-c3cf695fa26e None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.287853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b42a-40c1-4cc2-a0ee-c3cf695fa26e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.288135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b42a-40c1-4cc2-a0ee-c3cf695fa26e None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/groups/8fd5bf71a5b247f7a355fb6a4fc811c1/roles/0053c5c9a9f74809be6ecfcdeb35c100` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.290999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0b42a-40c1-4cc2-a0ee-c3cf695fa26e None admin] RBAC: Authorizing `identity:create_grant(project_id=efca54e53d414d1c9c96a76b5d58a31b, group_id=8fd5bf71a5b247f7a355fb6a4fc811c1, role_id=0053c5c9a9f74809be6ecfcdeb35c100)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:18.292451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0b42a-40c1-4cc2-a0ee-c3cf695fa26e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:18.411078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:18.416964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 205/401] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Jul 11 14:33:18 2022] PUT /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b/groups/8fd5bf71a5b247f7a355fb6a4fc811c1/roles/0053c5c9a9f74809be6ecfcdeb35c100 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:18.510988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28cb9a-9fd5-459d-adc7-f342050dc616 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.511959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28cb9a-9fd5-459d-adc7-f342050dc616 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.512511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28cb9a-9fd5-459d-adc7-f342050dc616 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.514624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 197/402] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:18.520370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8268e-2857-436e-9d5d-c168b8b18d10 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.520657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8268e-2857-436e-9d5d-c168b8b18d10 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.520949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8268e-2857-436e-9d5d-c168b8b18d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.543958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-fae8268e-2857-436e-9d5d-c168b8b18d10 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:18.545292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fae8268e-2857-436e-9d5d-c168b8b18d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:18.638166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 206/403] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:18.645436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29ffe8-df8d-4b4f-a9f7-743405f4e956 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.645728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29ffe8-df8d-4b4f-a9f7-743405f4e956 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.646008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29ffe8-df8d-4b4f-a9f7-743405f4e956 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.647557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 198/404] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:18.653757 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766c82-52f6-4da5-ade7-2567f35350cf None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.654120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766c82-52f6-4da5-ade7-2567f35350cf None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.654420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766c82-52f6-4da5-ade7-2567f35350cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.661567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29ffe8-df8d-4b4f-a9f7-743405f4e956 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.672565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-99766c82-52f6-4da5-ade7-2567f35350cf None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:18.673788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-99766c82-52f6-4da5-ade7-2567f35350cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:18.784979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 207/405] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:18.798354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99a71-8add-490d-8955-6d9bade2da6f None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.798647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99a71-8add-490d-8955-6d9bade2da6f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.798929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99a71-8add-490d-8955-6d9bade2da6f None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.800544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 208/406] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:18.806185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267257d3-3d77-476f-a886-1e8a1c7a3f07 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.806477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267257d3-3d77-476f-a886-1e8a1c7a3f07 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.806757 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267257d3-3d77-476f-a886-1e8a1c7a3f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.830076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-267257d3-3d77-476f-a886-1e8a1c7a3f07 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:18.831290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-267257d3-3d77-476f-a886-1e8a1c7a3f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:18.848490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29ffe8-df8d-4b4f-a9f7-743405f4e956 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:18.894763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682c37-495b-45c1-b0e3-2625de1ac526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:18.896295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682c37-495b-45c1-b0e3-2625de1ac526 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.896794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682c37-495b-45c1-b0e3-2625de1ac526 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.897250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682c37-495b-45c1-b0e3-2625de1ac526 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.898839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:18.912922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b682c37-495b-45c1-b0e3-2625de1ac526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:18.918333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 209/407] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:18.919229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267257d3-3d77-476f-a886-1e8a1c7a3f07 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-2b682c37-495b-45c1-b0e3-2625de1ac526 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:18.922727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:18.923676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:18.924506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:18.928244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 199/408] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:18.938046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682c37-495b-45c1-b0e3-2625de1ac526 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.969311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.046996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267257d3-3d77-476f-a886-1e8a1c7a3f07 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.067147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682c37-495b-45c1-b0e3-2625de1ac526 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.084959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc52de-46b4-439e-abb1-f9732c73b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.085918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc52de-46b4-439e-abb1-f9732c73b20d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.086234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc52de-46b4-439e-abb1-f9732c73b20d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.086509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc52de-46b4-439e-abb1-f9732c73b20d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.099633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc52de-46b4-439e-abb1-f9732c73b20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:19.108006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.108912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.109399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e6dc52de-46b4-439e-abb1-f9732c73b20d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:19.109522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:19.110451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:19.111286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:19.112851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.113821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:19.114358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 210/409] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:33:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:19.114627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.115168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc52de-46b4-439e-abb1-f9732c73b20d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.116426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.128537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 200/410] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:19.129795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.189565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.233753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.256577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc52de-46b4-439e-abb1-f9732c73b20d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.263593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49fc39-8ec4-4265-923d-14c6f27723af None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.304460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fed24-a261-44ff-bb6a-266e1120ae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.305203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fed24-a261-44ff-bb6a-266e1120ae78 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.305472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fed24-a261-44ff-bb6a-266e1120ae78 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.306391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fed24-a261-44ff-bb6a-266e1120ae78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.310569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.311627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.312212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.312683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.313581 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:19.314301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.316346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.317733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fed24-a261-44ff-bb6a-266e1120ae78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-af0fed24-a261-44ff-bb6a-266e1120ae78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:19.327509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:19.328636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:19.329571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:19.331571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 201/411] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:19.332855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.334664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 211/412] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:19.336974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fed24-a261-44ff-bb6a-266e1120ae78 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.452625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd2c86-b12b-423d-948b-16d1860cff96 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.458504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fed24-a261-44ff-bb6a-266e1120ae78 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.468404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.491049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf7613-dd86-4005-ab8d-6adb114903e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.492604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7613-dd86-4005-ab8d-6adb114903e8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.493110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7613-dd86-4005-ab8d-6adb114903e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.493567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7613-dd86-4005-ab8d-6adb114903e8 None admin] PATH_INFO: `/v3/groups/7b96375d6fbe4d1b9ed22d70097b5f95` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.495088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf7613-dd86-4005-ab8d-6adb114903e8 None admin] RBAC: Authorizing `identity:get_group(group_id=7b96375d6fbe4d1b9ed22d70097b5f95)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.495870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.496547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.496839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.497123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.497551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf7613-dd86-4005-ab8d-6adb114903e8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.497916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:19.498280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.499664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.500366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 202/413] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/groups/7b96375d6fbe4d1b9ed22d70097b5f95 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:19.501613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf7613-dd86-4005-ab8d-6adb114903e8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.514379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 212/414] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:19.515060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.516470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.637658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061cb43-2d5b-4eb3-b33c-bf9f21b3deec None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.644672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf7613-dd86-4005-ab8d-6adb114903e8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.678175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe10c-9afe-4d4d-8821-7661db9753a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.679099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe10c-9afe-4d4d-8821-7661db9753a1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.679374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe10c-9afe-4d4d-8821-7661db9753a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.679657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe10c-9afe-4d4d-8821-7661db9753a1 None admin] PATH_INFO: `/v3/projects/6d6ad6c08bb2467485d9a32d65d47482` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.681001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe10c-9afe-4d4d-8821-7661db9753a1 None admin] RBAC: Authorizing `identity:get_project(project_id=6d6ad6c08bb2467485d9a32d65d47482)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.682614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe10c-9afe-4d4d-8821-7661db9753a1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.684397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 213/415] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/projects/6d6ad6c08bb2467485d9a32d65d47482 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:19.685285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe10c-9afe-4d4d-8821-7661db9753a1 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.695541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754a20-cd4e-4b4a-b63b-003c36b4e0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.697314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754a20-cd4e-4b4a-b63b-003c36b4e0cc None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.697856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754a20-cd4e-4b4a-b63b-003c36b4e0cc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.698809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754a20-cd4e-4b4a-b63b-003c36b4e0cc None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.700617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0754a20-cd4e-4b4a-b63b-003c36b4e0cc None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.703337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0754a20-cd4e-4b4a-b63b-003c36b4e0cc None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.705928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 203/416] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:19.707122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754a20-cd4e-4b4a-b63b-003c36b4e0cc None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.734753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.811284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe10c-9afe-4d4d-8821-7661db9753a1 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.816242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.848497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754a20-cd4e-4b4a-b63b-003c36b4e0cc None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.850119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e125690-4116-4f5c-8618-a106cc147df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.851096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125690-4116-4f5c-8618-a106cc147df8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.852336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125690-4116-4f5c-8618-a106cc147df8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.852808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125690-4116-4f5c-8618-a106cc147df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.893775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796aa0-af74-4caf-b747-ca63f650d513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.894926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796aa0-af74-4caf-b747-ca63f650d513 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.895355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796aa0-af74-4caf-b747-ca63f650d513 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.895798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796aa0-af74-4caf-b747-ca63f650d513 None admin] PATH_INFO: `/v3/projects/6d6ad6c08bb2467485d9a32d65d47482/groups/7b96375d6fbe4d1b9ed22d70097b5f95/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.897918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8796aa0-af74-4caf-b747-ca63f650d513 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6ad6c08bb2467485d9a32d65d47482, group_id=7b96375d6fbe4d1b9ed22d70097b5f95, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.900116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8796aa0-af74-4caf-b747-ca63f650d513 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.936914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e125690-4116-4f5c-8618-a106cc147df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.938439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e125690-4116-4f5c-8618-a106cc147df8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.982038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.984554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 204/417] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Jul 11 14:33:19 2022] PUT /identity/v3/projects/6d6ad6c08bb2467485d9a32d65d47482/groups/7b96375d6fbe4d1b9ed22d70097b5f95/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:19.985739 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796aa0-af74-4caf-b747-ca63f650d513 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.091747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 214/418] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:20.097042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e125690-4116-4f5c-8618-a106cc147df8 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.123762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796aa0-af74-4caf-b747-ca63f650d513 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.168863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb062-ef37-49ff-84c6-a83d61c657dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.171064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb062-ef37-49ff-84c6-a83d61c657dc None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.171674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb062-ef37-49ff-84c6-a83d61c657dc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.172157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb062-ef37-49ff-84c6-a83d61c657dc None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.173766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb062-ef37-49ff-84c6-a83d61c657dc None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.175460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb062-ef37-49ff-84c6-a83d61c657dc None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.179508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 205/419] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:20.186064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb062-ef37-49ff-84c6-a83d61c657dc None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.191798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.268326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e125690-4116-4f5c-8618-a106cc147df8 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.327415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d92de-669f-42e2-8014-d98c8a1dd2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.328617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d92de-669f-42e2-8014-d98c8a1dd2d9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.329078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d92de-669f-42e2-8014-d98c8a1dd2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.329530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d92de-669f-42e2-8014-d98c8a1dd2d9 None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.331443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d92de-669f-42e2-8014-d98c8a1dd2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.333361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d92de-669f-42e2-8014-d98c8a1dd2d9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.335883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 215/420] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:20.338214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb062-ef37-49ff-84c6-a83d61c657dc None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.341614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d92de-669f-42e2-8014-d98c8a1dd2d9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.358235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.419855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19ceb6-4b37-497e-aaed-72629738a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.420650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ceb6-4b37-497e-aaed-72629738a9f2 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.420963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ceb6-4b37-497e-aaed-72629738a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.421702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ceb6-4b37-497e-aaed-72629738a9f2 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/groups/8fd5bf71a5b247f7a355fb6a4fc811c1/roles/0053c5c9a9f74809be6ecfcdeb35c100` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.431497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19ceb6-4b37-497e-aaed-72629738a9f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=60578e3e4a6e4935acb2a38bab0ac874, group_id=8fd5bf71a5b247f7a355fb6a4fc811c1, role_id=0053c5c9a9f74809be6ecfcdeb35c100)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.433161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19ceb6-4b37-497e-aaed-72629738a9f2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.478900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d92de-669f-42e2-8014-d98c8a1dd2d9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.518267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 206/421] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Jul 11 14:33:20 2022] PUT /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874/groups/8fd5bf71a5b247f7a355fb6a4fc811c1/roles/0053c5c9a9f74809be6ecfcdeb35c100 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:33:20.521423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad328b-9ccc-4b60-8d72-16ded7c69d45 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.522593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad328b-9ccc-4b60-8d72-16ded7c69d45 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.524037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad328b-9ccc-4b60-8d72-16ded7c69d45 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.525168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf7d2c-d4f0-46e9-bb63-d774ed140e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.527551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 207/422] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:20.528142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf7d2c-d4f0-46e9-bb63-d774ed140e45 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.528660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf7d2c-d4f0-46e9-bb63-d774ed140e45 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.529115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf7d2c-d4f0-46e9-bb63-d774ed140e45 None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.530715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf7d2c-d4f0-46e9-bb63-d774ed140e45 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.533910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff261-169e-4e3a-9a8a-7f8f887ee243 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.534456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff261-169e-4e3a-9a8a-7f8f887ee243 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.534951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff261-169e-4e3a-9a8a-7f8f887ee243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.536809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf7d2c-d4f0-46e9-bb63-d774ed140e45 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 216/423] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:20.547586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf7d2c-d4f0-46e9-bb63-d774ed140e45 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.574544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-facff261-169e-4e3a-9a8a-7f8f887ee243 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:20.577298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-facff261-169e-4e3a-9a8a-7f8f887ee243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:20.679272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.686255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.693644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 208/424] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:20.695280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514877-3041-487d-bc51-3b46fd247cd5 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.695760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514877-3041-487d-bc51-3b46fd247cd5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.696040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514877-3041-487d-bc51-3b46fd247cd5 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.697484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 209/425] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:20.702709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9fb8c-dfeb-4eba-b9cd-6270a366cbc5 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.707314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9fb8c-dfeb-4eba-b9cd-6270a366cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.707314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9fb8c-dfeb-4eba-b9cd-6270a366cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.710847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf7d2c-d4f0-46e9-bb63-d774ed140e45 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.721343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7cc9fb8c-dfeb-4eba-b9cd-6270a366cbc5 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:20.723248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7cc9fb8c-dfeb-4eba-b9cd-6270a366cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:20.763249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.764269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.764557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.764866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.765669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] RBAC: Adding query filter params (group.id=8fd5bf71a5b247f7a355fb6a4fc811c1, role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:20.765984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.767446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.775015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 217/426] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/role_assignments?group.id=8fd5bf71a5b247f7a355fb6a4fc811c1&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:20.775900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.818997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 210/427] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:20.874204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9fb8c-dfeb-4eba-b9cd-6270a366cbc5 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.920136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edda97-4864-4d4c-9016-8c86c2e22e6d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.987032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f35dcb-77a0-4457-9ec0-542f023356b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.987833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35dcb-77a0-4457-9ec0-542f023356b3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.989624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35dcb-77a0-4457-9ec0-542f023356b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.989624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35dcb-77a0-4457-9ec0-542f023356b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.002378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.010933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f35dcb-77a0-4457-9ec0-542f023356b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-c9f35dcb-77a0-4457-9ec0-542f023356b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:21.019926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:21.020840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:21.021670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 218/428] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:21.029501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f35dcb-77a0-4457-9ec0-542f023356b3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.084020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9fb8c-dfeb-4eba-b9cd-6270a366cbc5 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:21.111294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.128682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b8465-9941-4158-b053-cfc6521b057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:21.130441 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b8465-9941-4158-b053-cfc6521b057e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.130733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b8465-9941-4158-b053-cfc6521b057e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.131019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b8465-9941-4158-b053-cfc6521b057e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.145218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b8465-9941-4158-b053-cfc6521b057e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-204b8465-9941-4158-b053-cfc6521b057e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:21.155796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:21.156756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:21.157570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:21.160936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 211/429] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:21.167124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b8465-9941-4158-b053-cfc6521b057e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.185149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f35dcb-77a0-4457-9ec0-542f023356b3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:21.233050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:21.234018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.234152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.234517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.235346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:21.235726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:21.238180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:21.255147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 219/430] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:21.258033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.307724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b8465-9941-4158-b053-cfc6521b057e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:21.331898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.359414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:21.360739 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.361376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.361932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.362917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:21.363445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:21.365531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:21.378704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 212/431] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:21.383673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.384536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea235-aa35-42d5-ad45-211fdf1b19e9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:21.427496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0163c-0ff3-41c7-b96c-acad73b3710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:21.428338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0163c-0ff3-41c7-b96c-acad73b3710e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.428449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0163c-0ff3-41c7-b96c-acad73b3710e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.428677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0163c-0ff3-41c7-b96c-acad73b3710e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.466516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.521229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e9aa3-d1fb-4678-beeb-38a1e1d3eb8f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:21.530958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0163c-0ff3-41c7-b96c-acad73b3710e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:21.532747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0163c-0ff3-41c7-b96c-acad73b3710e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:21.577944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768670ae-419f-4a7a-ba18-b1afe3c14511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:21.579157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768670ae-419f-4a7a-ba18-b1afe3c14511 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.579650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768670ae-419f-4a7a-ba18-b1afe3c14511 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.580127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768670ae-419f-4a7a-ba18-b1afe3c14511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.614863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.672743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 220/432] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:21.684534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768670ae-419f-4a7a-ba18-b1afe3c14511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:21.684893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0163c-0ff3-41c7-b96c-acad73b3710e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.686015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768670ae-419f-4a7a-ba18-b1afe3c14511 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:21.745636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.819970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0163c-0ff3-41c7-b96c-acad73b3710e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:21.822198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 213/433] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:33:21.829691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768670ae-419f-4a7a-ba18-b1afe3c14511 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.861666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750515f-9bb3-4542-88a0-7378802bee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:21.863542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750515f-9bb3-4542-88a0-7378802bee62 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.864001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750515f-9bb3-4542-88a0-7378802bee62 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.864431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750515f-9bb3-4542-88a0-7378802bee62 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.866506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750515f-9bb3-4542-88a0-7378802bee62 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:21.868371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750515f-9bb3-4542-88a0-7378802bee62 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:21.871766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 221/434] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:21.876851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750515f-9bb3-4542-88a0-7378802bee62 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.916255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.956744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768670ae-419f-4a7a-ba18-b1afe3c14511 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:22.002812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b4447-5b24-4721-9575-46962dff768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:22.004232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b4447-5b24-4721-9575-46962dff768f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.004931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b4447-5b24-4721-9575-46962dff768f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.005356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b4447-5b24-4721-9575-46962dff768f None admin] PATH_INFO: `/v3/projects/efca54e53d414d1c9c96a76b5d58a31b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.006736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b4447-5b24-4721-9575-46962dff768f None admin] RBAC: Authorizing `identity:get_project(project_id=efca54e53d414d1c9c96a76b5d58a31b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:22.007053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750515f-9bb3-4542-88a0-7378802bee62 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:22.009031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b4447-5b24-4721-9575-46962dff768f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:22.011830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 214/435] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/projects/efca54e53d414d1c9c96a76b5d58a31b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:22.022121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b4447-5b24-4721-9575-46962dff768f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:22.037427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:22.060571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ced386-95c8-49bf-96d5-5ccb861422f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:22.061671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ced386-95c8-49bf-96d5-5ccb861422f2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.062096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ced386-95c8-49bf-96d5-5ccb861422f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.062563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ced386-95c8-49bf-96d5-5ccb861422f2 None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.064064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ced386-95c8-49bf-96d5-5ccb861422f2 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:22.066059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ced386-95c8-49bf-96d5-5ccb861422f2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:22.074125 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 222/436] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:22.075202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ced386-95c8-49bf-96d5-5ccb861422f2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:22.137696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b4447-5b24-4721-9575-46962dff768f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:22.176662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abfc2e-2cff-410f-9524-03b7d3c765cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:22.177626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfc2e-2cff-410f-9524-03b7d3c765cf None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.177917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfc2e-2cff-410f-9524-03b7d3c765cf None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.178228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfc2e-2cff-410f-9524-03b7d3c765cf None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.179423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abfc2e-2cff-410f-9524-03b7d3c765cf None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:22.181172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:22.181757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abfc2e-2cff-410f-9524-03b7d3c765cf None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:22.187775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ced386-95c8-49bf-96d5-5ccb861422f2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:22.188323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 215/437] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:22 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:22.195132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abfc2e-2cff-410f-9524-03b7d3c765cf None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:22.225390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d820a3-dd6e-4e84-b16a-e309c6cc1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:22.226353 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d820a3-dd6e-4e84-b16a-e309c6cc1ccd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.226777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d820a3-dd6e-4e84-b16a-e309c6cc1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.227194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d820a3-dd6e-4e84-b16a-e309c6cc1ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.228210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d820a3-dd6e-4e84-b16a-e309c6cc1ccd None admin] RBAC: Adding query filter params (group.id=8fd5bf71a5b247f7a355fb6a4fc811c1, role.id=20ef9cdb3c3c4a79bfacad902829d018, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:22.228677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d820a3-dd6e-4e84-b16a-e309c6cc1ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:22.230294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d820a3-dd6e-4e84-b16a-e309c6cc1ccd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:22.242151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 223/438] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:22 2022] GET /identity/v3/role_assignments?group.id=8fd5bf71a5b247f7a355fb6a4fc811c1&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=20ef9cdb3c3c4a79bfacad902829d018 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:22.287701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:22.310090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abfc2e-2cff-410f-9524-03b7d3c765cf None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:22.351142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd5c51-d741-49fd-9882-8b458da7651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:22.352066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd5c51-d741-49fd-9882-8b458da7651d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.352540 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd5c51-d741-49fd-9882-8b458da7651d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.352960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd5c51-d741-49fd-9882-8b458da7651d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.354011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd5c51-d741-49fd-9882-8b458da7651d None admin] RBAC: Adding query filter params (group.id=8fd5bf71a5b247f7a355fb6a4fc811c1, role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=efca54e53d414d1c9c96a76b5d58a31b) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:22.354537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd5c51-d741-49fd-9882-8b458da7651d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:22.356170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd5c51-d741-49fd-9882-8b458da7651d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:22.363780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 216/439] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:22 2022] GET /identity/v3/role_assignments?group.id=8fd5bf71a5b247f7a355fb6a4fc811c1&scope.project.id=efca54e53d414d1c9c96a76b5d58a31b&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:22.373949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c51d21-e82b-4409-811c-e3406c1012e0 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.374259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c51d21-e82b-4409-811c-e3406c1012e0 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.374652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c51d21-e82b-4409-811c-e3406c1012e0 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.376143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 224/440] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:22.382167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69540-a69b-4019-9e25-ef5628f237b2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.382691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69540-a69b-4019-9e25-ef5628f237b2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.383147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69540-a69b-4019-9e25-ef5628f237b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.403661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-03f69540-a69b-4019-9e25-ef5628f237b2 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:22.405184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-03f69540-a69b-4019-9e25-ef5628f237b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:22.487932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 217/441] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:22.512578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c51d21-e82b-4409-811c-e3406c1012e0 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:22.626611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c51d21-e82b-4409-811c-e3406c1012e0 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:22.664853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ae459-0a7f-4b44-bf64-c089eed9e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:22.665696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae459-0a7f-4b44-bf64-c089eed9e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.665976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae459-0a7f-4b44-bf64-c089eed9e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.666282 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae459-0a7f-4b44-bf64-c089eed9e8f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.677959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ae459-0a7f-4b44-bf64-c089eed9e8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e58ae459-0a7f-4b44-bf64-c089eed9e8f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:22.686374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:22.687539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:22.688478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 225/442] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:22.693410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69540-a69b-4019-9e25-ef5628f237b2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:22.782522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:22.797135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e3fa-4993-42e5-b7d1-da740c618334 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.797662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e3fa-4993-42e5-b7d1-da740c618334 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.797951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e3fa-4993-42e5-b7d1-da740c618334 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.799397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 226/443] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:22.804896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d952c-d87f-4b36-8b52-d0f9d999e1ea None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.809342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d952c-d87f-4b36-8b52-d0f9d999e1ea None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.809342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d952c-d87f-4b36-8b52-d0f9d999e1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.809510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69540-a69b-4019-9e25-ef5628f237b2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:22.825868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-677d952c-d87f-4b36-8b52-d0f9d999e1ea None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:22.827094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-677d952c-d87f-4b36-8b52-d0f9d999e1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:22.844030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:22.847956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:22.848723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.849161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.854273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.854273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:22.854273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:22.854273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:22.862867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 218/444] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:22.869052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:22.918408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 227/445] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:22.937869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d952c-d87f-4b36-8b52-d0f9d999e1ea None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:22.991151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b449d04-012b-4675-a5d6-b9921362a15d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.026394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fb54-0e83-4889-a49a-ef993f55b9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.027043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fb54-0e83-4889-a49a-ef993f55b9e1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.027326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fb54-0e83-4889-a49a-ef993f55b9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.027603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fb54-0e83-4889-a49a-ef993f55b9e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.036079 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.040962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d952c-d87f-4b36-8b52-d0f9d999e1ea None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.076422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67327c9f-c57e-40b4-9b9c-42f9bb07c381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.077263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327c9f-c57e-40b4-9b9c-42f9bb07c381 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.077547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327c9f-c57e-40b4-9b9c-42f9bb07c381 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.077826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327c9f-c57e-40b4-9b9c-42f9bb07c381 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.089159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67327c9f-c57e-40b4-9b9c-42f9bb07c381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:23.097162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436fb54-0e83-4889-a49a-ef993f55b9e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-67327c9f-c57e-40b4-9b9c-42f9bb07c381 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:23.097369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:23.098455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:23.099326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:23.100027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436fb54-0e83-4889-a49a-ef993f55b9e1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.100097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 228/446] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:33:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:23.105205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67327c9f-c57e-40b4-9b9c-42f9bb07c381 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.117945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.201306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 219/447] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:33:23.213771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67327c9f-c57e-40b4-9b9c-42f9bb07c381 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.214317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fb54-0e83-4889-a49a-ef993f55b9e1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.249402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.250073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.250385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.250661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.251406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:23.251715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.253104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.253936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.262594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 229/448] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:23.268489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.316246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fb54-0e83-4889-a49a-ef993f55b9e1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.349704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.359222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0905cf-4372-4732-84c7-5b8cde309354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.363423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0905cf-4372-4732-84c7-5b8cde309354 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.363423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0905cf-4372-4732-84c7-5b8cde309354 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.363423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0905cf-4372-4732-84c7-5b8cde309354 None admin] PATH_INFO: `/v3/projects/6d6ad6c08bb2467485d9a32d65d47482` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.363423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0905cf-4372-4732-84c7-5b8cde309354 None admin] RBAC: Authorizing `identity:get_project(project_id=6d6ad6c08bb2467485d9a32d65d47482)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.363423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0905cf-4372-4732-84c7-5b8cde309354 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.365031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 220/449] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/projects/6d6ad6c08bb2467485d9a32d65d47482 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:23.371114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0905cf-4372-4732-84c7-5b8cde309354 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.380424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82590-61c3-49ea-bbf9-ff0b79737f69 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.415748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe041bd-0995-4894-9755-c79184053c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.416402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe041bd-0995-4894-9755-c79184053c19 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.416685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe041bd-0995-4894-9755-c79184053c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.416960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe041bd-0995-4894-9755-c79184053c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.472959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0905cf-4372-4732-84c7-5b8cde309354 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.480990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.486833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe041bd-0995-4894-9755-c79184053c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.488448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe041bd-0995-4894-9755-c79184053c19 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.507224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d648a-eea2-47f7-8e76-e7f01bd518d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.508087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d648a-eea2-47f7-8e76-e7f01bd518d5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.508367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d648a-eea2-47f7-8e76-e7f01bd518d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.508640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d648a-eea2-47f7-8e76-e7f01bd518d5 None admin] PATH_INFO: `/v3/groups/7b96375d6fbe4d1b9ed22d70097b5f95` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.510459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d648a-eea2-47f7-8e76-e7f01bd518d5 None admin] RBAC: Authorizing `identity:get_group(group_id=7b96375d6fbe4d1b9ed22d70097b5f95)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.511886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d648a-eea2-47f7-8e76-e7f01bd518d5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.513515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 221/450] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/groups/7b96375d6fbe4d1b9ed22d70097b5f95 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:23.519651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d648a-eea2-47f7-8e76-e7f01bd518d5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.560285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.590731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 230/451] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:33:23.596500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe041bd-0995-4894-9755-c79184053c19 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.620804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d648a-eea2-47f7-8e76-e7f01bd518d5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.655678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.656469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.656752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.657030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.657846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] RBAC: Adding query filter params (group.id=7b96375d6fbe4d1b9ed22d70097b5f95, role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=6d6ad6c08bb2467485d9a32d65d47482) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:23.658189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.659614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.665953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 222/452] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/role_assignments?group.id=7b96375d6fbe4d1b9ed22d70097b5f95&scope.project.id=6d6ad6c08bb2467485d9a32d65d47482&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:23.701542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe041bd-0995-4894-9755-c79184053c19 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.744654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce30093-0a87-49c3-bb67-5b44f845f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.745558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce30093-0a87-49c3-bb67-5b44f845f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.745741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce30093-0a87-49c3-bb67-5b44f845f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.746013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce30093-0a87-49c3-bb67-5b44f845f5f8 None admin] PATH_INFO: `/v3/projects/60578e3e4a6e4935acb2a38bab0ac874` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.747354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce30093-0a87-49c3-bb67-5b44f845f5f8 None admin] RBAC: Authorizing `identity:get_project(project_id=60578e3e4a6e4935acb2a38bab0ac874)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.748863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce30093-0a87-49c3-bb67-5b44f845f5f8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.750756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 231/453] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/projects/60578e3e4a6e4935acb2a38bab0ac874 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:23.756494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.800224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.863235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f978f-3037-4e34-8de6-0d92eb29909c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.897415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f58ce-5559-4423-a404-bde7b042714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.898295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f58ce-5559-4423-a404-bde7b042714d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.898579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f58ce-5559-4423-a404-bde7b042714d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.898854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f58ce-5559-4423-a404-bde7b042714d None admin] PATH_INFO: `/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.900041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f58ce-5559-4423-a404-bde7b042714d None admin] RBAC: Authorizing `identity:get_group(group_id=8fd5bf71a5b247f7a355fb6a4fc811c1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.901454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f58ce-5559-4423-a404-bde7b042714d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.903103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 223/454] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/groups/8fd5bf71a5b247f7a355fb6a4fc811c1 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:23.909015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce30093-0a87-49c3-bb67-5b44f845f5f8 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.951503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:24.008589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce30093-0a87-49c3-bb67-5b44f845f5f8 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:24.043301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca9dc4-5bef-4ed1-94c7-cdd6a613b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:24.043960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9dc4-5bef-4ed1-94c7-cdd6a613b88a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.044236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9dc4-5bef-4ed1-94c7-cdd6a613b88a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.044514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9dc4-5bef-4ed1-94c7-cdd6a613b88a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:24.045338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca9dc4-5bef-4ed1-94c7-cdd6a613b88a None admin] RBAC: Adding query filter params (group.id=8fd5bf71a5b247f7a355fb6a4fc811c1, role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=60578e3e4a6e4935acb2a38bab0ac874) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:24.045651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca9dc4-5bef-4ed1-94c7-cdd6a613b88a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:24.047103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca9dc4-5bef-4ed1-94c7-cdd6a613b88a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:24.052922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 232/455] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/role_assignments?group.id=8fd5bf71a5b247f7a355fb6a4fc811c1&scope.project.id=60578e3e4a6e4935acb2a38bab0ac874&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:26.850979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661479-6e9e-450a-a9a8-e1962508df08 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:26.851492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661479-6e9e-450a-a9a8-e1962508df08 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:26.851603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661479-6e9e-450a-a9a8-e1962508df08 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:26.853182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 224/456] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:26.859027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100719-93ea-457c-8cdb-2131d4936e49 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:26.859906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100719-93ea-457c-8cdb-2131d4936e49 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:26.860390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100719-93ea-457c-8cdb-2131d4936e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:26.887099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f0100719-93ea-457c-8cdb-2131d4936e49 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:26.888646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f0100719-93ea-457c-8cdb-2131d4936e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:26.949351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44454e-ea0a-419e-9333-0be21b1159d5 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:26.949782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44454e-ea0a-419e-9333-0be21b1159d5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:26.950410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44454e-ea0a-419e-9333-0be21b1159d5 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:26.952332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 225/457] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:26.959045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07cbd-d4ae-407e-9875-c788df1bcb97 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:26.959612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07cbd-d4ae-407e-9875-c788df1bcb97 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:26.960098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07cbd-d4ae-407e-9875-c788df1bcb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:26.985938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 233/458] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:26.988882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1ba07cbd-d4ae-407e-9875-c788df1bcb97 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:26.990347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1ba07cbd-d4ae-407e-9875-c788df1bcb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:27.075813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0100719-93ea-457c-8cdb-2131d4936e49 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.097075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 226/459] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:27.122512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:27.145530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071814e-94b5-4fd6-81a8-6034bf2e7b83 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.145876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071814e-94b5-4fd6-81a8-6034bf2e7b83 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.146091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071814e-94b5-4fd6-81a8-6034bf2e7b83 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.147691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 227/460] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:27.153819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5f5b-3e9b-4ca8-beb6-0b1803c46569 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.154209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5f5b-3e9b-4ca8-beb6-0b1803c46569 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.154490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5f5b-3e9b-4ca8-beb6-0b1803c46569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.173133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a71f5f5b-3e9b-4ca8-beb6-0b1803c46569 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:27.174822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a71f5f5b-3e9b-4ca8-beb6-0b1803c46569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:27.207680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0100719-93ea-457c-8cdb-2131d4936e49 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:27.207870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:27.244588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:27.245392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.245672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.245941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.251186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 228/461] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:27.252035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f5f5b-3e9b-4ca8-beb6-0b1803c46569 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.266800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:27.268261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:27.299265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:27.300224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:27.301097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:27.301097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:27.301097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:27.301097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:27.301097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 234/462] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:27.308257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.362783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f5f5b-3e9b-4ca8-beb6-0b1803c46569 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:27.402329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:27.403447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:27.404186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.404475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.404752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.415618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:27.417480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:27.419151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bcac6-44f7-4c83-ae70-39b2bd089d9a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:27.439415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:27.440419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:27.441355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:27.441355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:27.441355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:27.441355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:27.441355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 229/463] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:27.441633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.460900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f979c-307f-45ff-a398-2bd39802ec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:27.461563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f979c-307f-45ff-a398-2bd39802ec9e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.462424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f979c-307f-45ff-a398-2bd39802ec9e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.462708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f979c-307f-45ff-a398-2bd39802ec9e None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.463431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f979c-307f-45ff-a398-2bd39802ec9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:27.463570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:27.463739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f979c-307f-45ff-a398-2bd39802ec9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:27.465128 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f979c-307f-45ff-a398-2bd39802ec9e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:27.477720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 235/464] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:27.478934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f7d40-1556-4902-a2fd-278eecad9249 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.479227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f7d40-1556-4902-a2fd-278eecad9249 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.479501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f7d40-1556-4902-a2fd-278eecad9249 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.484628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 236/465] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:27.484628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f7d40-1556-4902-a2fd-278eecad9249 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.560913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb090d-71e8-4609-baff-97dd31f29703 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:27.590783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f7d40-1556-4902-a2fd-278eecad9249 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:27.597585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:27.598707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.599171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.599686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.610732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:27.612263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:27.624720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7cf17-fd74-4040-ac84-62d0c8c43f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:27.625248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7cf17-fd74-4040-ac84-62d0c8c43f2a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.625530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7cf17-fd74-4040-ac84-62d0c8c43f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.625806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7cf17-fd74-4040-ac84-62d0c8c43f2a None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.626555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7cf17-fd74-4040-ac84-62d0c8c43f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:27.626862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7cf17-fd74-4040-ac84-62d0c8c43f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:27.628242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7cf17-fd74-4040-ac84-62d0c8c43f2a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:27.630059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:27.631027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:27.631907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:27.631907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:27.631907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:27.631907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:27.631907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 230/466] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:27.632175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.646643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 237/467] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:27.647921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec878-a41f-48b9-ae36-4dcc32a4dc7d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.648205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec878-a41f-48b9-ae36-4dcc32a4dc7d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.648475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec878-a41f-48b9-ae36-4dcc32a4dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.660002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:27.667061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-aaeec878-a41f-48b9-ae36-4dcc32a4dc7d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:27.671877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-aaeec878-a41f-48b9-ae36-4dcc32a4dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:27.712938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:27.736561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 238/468] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:27.737278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeec878-a41f-48b9-ae36-4dcc32a4dc7d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.758402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff22ea-ec6f-4a7a-a8af-acd7764b50d3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:27.794938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b152a5-59ad-4c83-84c9-3fa555018c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:27.795588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b152a5-59ad-4c83-84c9-3fa555018c6c None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.795866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b152a5-59ad-4c83-84c9-3fa555018c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.796138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b152a5-59ad-4c83-84c9-3fa555018c6c None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.796840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b152a5-59ad-4c83-84c9-3fa555018c6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:27.798307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b152a5-59ad-4c83-84c9-3fa555018c6c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:27.854678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeec878-a41f-48b9-ae36-4dcc32a4dc7d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:27.891648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.891868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.892144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.892866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:27.893176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:27.894619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:27.897944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:27.901768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 231/469] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:33:27 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:27.903109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b152a5-59ad-4c83-84c9-3fa555018c6c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.919108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 239/470] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:27.920476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.035568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b152a5-59ad-4c83-84c9-3fa555018c6c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.039505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1a6e-b608-4fd5-a50e-85d15500f326 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.066341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.076792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf6c7-ba30-41f0-9387-7dc0c4f40624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.077586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf6c7-ba30-41f0-9387-7dc0c4f40624 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.077823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf6c7-ba30-41f0-9387-7dc0c4f40624 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.078199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf6c7-ba30-41f0-9387-7dc0c4f40624 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.078831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.078980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bf6c7-ba30-41f0-9387-7dc0c4f40624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.079918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.080280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bf6c7-ba30-41f0-9387-7dc0c4f40624 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.080397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.080622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.093303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.094823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:28.112857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:28.113773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:28.114714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:28.114714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:28.114714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:28.114714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:28.114714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 240/471] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:28.115333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.167544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.183419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 232/472] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:33:27 2022] POST /identity/v3/users => generated 246 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:28.186218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497978a3-2e17-455a-8267-0f27b0cff794 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.186218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497978a3-2e17-455a-8267-0f27b0cff794 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.186218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497978a3-2e17-455a-8267-0f27b0cff794 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.191605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 233/473] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:28.191605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497978a3-2e17-455a-8267-0f27b0cff794 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.233960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1c453-3133-4884-89d3-229e67b25b3b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.276479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daa8ef-497c-44cf-b6bb-1b9a0b09c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.277172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa8ef-497c-44cf-b6bb-1b9a0b09c01a None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.277461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa8ef-497c-44cf-b6bb-1b9a0b09c01a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.277741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa8ef-497c-44cf-b6bb-1b9a0b09c01a None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.278513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daa8ef-497c-44cf-b6bb-1b9a0b09c01a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.280133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daa8ef-497c-44cf-b6bb-1b9a0b09c01a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.336590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497978a3-2e17-455a-8267-0f27b0cff794 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.377700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.378703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.378990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.379267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.379999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:28.380306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.381705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.387090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 241/474] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:33:28 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:28.388724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4641d-5305-4371-a5f9-55a1f22fb481 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.389509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4641d-5305-4371-a5f9-55a1f22fb481 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.390644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4641d-5305-4371-a5f9-55a1f22fb481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.402245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 234/475] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:28.405057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.420281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-04b4641d-5305-4371-a5f9-55a1f22fb481 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:28.421501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-04b4641d-5305-4371-a5f9-55a1f22fb481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:28.463724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.508039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 242/476] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:28.532889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34019a-5347-4fce-aeb1-4029d2e8b31f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.534860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4641d-5305-4371-a5f9-55a1f22fb481 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.573522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b1ca7-9497-492c-952b-8a3af74e463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.574592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b1ca7-9497-492c-952b-8a3af74e463e None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.575083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b1ca7-9497-492c-952b-8a3af74e463e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.575591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b1ca7-9497-492c-952b-8a3af74e463e None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.575961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.576759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b1ca7-9497-492c-952b-8a3af74e463e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.578448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b1ca7-9497-492c-952b-8a3af74e463e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.652199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4641d-5305-4371-a5f9-55a1f22fb481 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.689110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.689716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.690050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.690362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.691329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.692795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.699010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 235/477] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:33:28 2022] POST /identity/v3/users => generated 249 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:28.758231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.sql.core [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:33:28.758231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 14:33:28.758231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [parameters: {'id': '7980efe0c94b4b718aa415b6fab8b7b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 14:33:28.758231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87427) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result.read() Jul 11 14:33:28.781632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:33:28.782662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application yield resource Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise self.value Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application session.commit() Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:33:28.783594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:33:28.785126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:33:28.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result.read() Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:33:28.789673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [parameters: {'id': '7980efe0c94b4b718aa415b6fab8b7b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:28.796279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 14:33:28.799689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:28.801789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 243/478] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Jul 11 14:33:28 2022] POST /identity/v3/roles => generated 144 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:28.801931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b1ca7-9497-492c-952b-8a3af74e463e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.940002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.944464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b1ca7-9497-492c-952b-8a3af74e463e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.983379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500efaf7-0e2f-4bf7-9752-d093834aa2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.984200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500efaf7-0e2f-4bf7-9752-d093834aa2ed None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.984537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500efaf7-0e2f-4bf7-9752-d093834aa2ed None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.984862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500efaf7-0e2f-4bf7-9752-d093834aa2ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.995367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500efaf7-0e2f-4bf7-9752-d093834aa2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-500efaf7-0e2f-4bf7-9752-d093834aa2ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:29.003807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:29.004758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:29.005612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 236/479] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:33:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:29.012644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:29.119218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:29.123596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13fc0c-b53e-445a-8669-604386026ca5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:29.162503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7805054-8087-4812-b7e6-c8ff007058ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:29.163174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805054-8087-4812-b7e6-c8ff007058ac None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:29.163510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805054-8087-4812-b7e6-c8ff007058ac None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:29.163785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805054-8087-4812-b7e6-c8ff007058ac None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:29.164583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7805054-8087-4812-b7e6-c8ff007058ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:29.164979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7805054-8087-4812-b7e6-c8ff007058ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:29.166832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7805054-8087-4812-b7e6-c8ff007058ac None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:29.178025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 244/480] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:30.219668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523764-bf4f-4622-a3bf-ed47e4c285e2 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.220677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523764-bf4f-4622-a3bf-ed47e4c285e2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.221192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523764-bf4f-4622-a3bf-ed47e4c285e2 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.223039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 237/481] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:30.228656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e434-2682-4694-aa68-4eec76475ed0 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.229670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e434-2682-4694-aa68-4eec76475ed0 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.230180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e434-2682-4694-aa68-4eec76475ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.248653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-2067e434-2682-4694-aa68-4eec76475ed0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:30.250204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2067e434-2682-4694-aa68-4eec76475ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:30.332088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 245/482] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:30.369069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43523764-bf4f-4622-a3bf-ed47e4c285e2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:30.497497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43523764-bf4f-4622-a3bf-ed47e4c285e2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:30.533419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18222d-153b-4868-8097-441a22b318cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:30.534607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18222d-153b-4868-8097-441a22b318cf None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.535135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18222d-153b-4868-8097-441a22b318cf None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.535636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18222d-153b-4868-8097-441a22b318cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.547143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18222d-153b-4868-8097-441a22b318cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-5e18222d-153b-4868-8097-441a22b318cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:30.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:30.556967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:30.557790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:30.560424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 238/483] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:30.566372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067e434-2682-4694-aa68-4eec76475ed0 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:30.663462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067e434-2682-4694-aa68-4eec76475ed0 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:30.712659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43025908-268b-4c1f-aee9-df151d4a1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:30.713626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025908-268b-4c1f-aee9-df151d4a1512 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.714139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025908-268b-4c1f-aee9-df151d4a1512 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.714601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025908-268b-4c1f-aee9-df151d4a1512 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.715538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43025908-268b-4c1f-aee9-df151d4a1512 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:30.716178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43025908-268b-4c1f-aee9-df151d4a1512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:30.717798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43025908-268b-4c1f-aee9-df151d4a1512 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:30.727971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 246/484] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:30.735172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18222d-153b-4868-8097-441a22b318cf None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:30.783411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:30.917425 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18222d-153b-4868-8097-441a22b318cf None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:30.926396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22ecc8-9baf-4507-b332-27f36e0bc9e7 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.927031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22ecc8-9baf-4507-b332-27f36e0bc9e7 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.927516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22ecc8-9baf-4507-b332-27f36e0bc9e7 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.929377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 247/485] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:30.934214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bf383-b0e9-4a50-9513-5346769b785c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.934505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bf383-b0e9-4a50-9513-5346769b785c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.934786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bf383-b0e9-4a50-9513-5346769b785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.964031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0d8bf383-b0e9-4a50-9513-5346769b785c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:30.965250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0d8bf383-b0e9-4a50-9513-5346769b785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:30.981997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:30.982832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.983117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.983393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.996149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:30.997607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:31.016178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:31.017045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:31.017934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:31.017934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:31.017934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:31.017934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:31.017934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 239/486] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:31.029780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.090934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 248/487] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:31.093500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581208a-374d-4351-af8f-ef504922aad6 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.093973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581208a-374d-4351-af8f-ef504922aad6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.094459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581208a-374d-4351-af8f-ef504922aad6 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.096207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 249/488] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:31.101466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fa31-4031-4013-a154-9a9608d61953 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.101762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fa31-4031-4013-a154-9a9608d61953 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.102052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fa31-4031-4013-a154-9a9608d61953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.123761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c672fa31-4031-4013-a154-9a9608d61953 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:31.124997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c672fa31-4031-4013-a154-9a9608d61953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:31.142420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:31.178281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfefd3-22d3-481d-b2df-0befa4b57035 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:31.202132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 250/489] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:31.202132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672fa31-4031-4013-a154-9a9608d61953 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.220367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:31.230304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:31.231593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.233934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.233934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.233934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:31.233934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:31.235317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:31.248511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 240/490] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:31.253659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.331016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672fa31-4031-4013-a154-9a9608d61953 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:31.365866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93305-ddc1-490c-906b-d2a0b6a2e881 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:31.378422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4ee3-aa5a-41db-9ee3-5915ab9294ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:31.379233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4ee3-aa5a-41db-9ee3-5915ab9294ef None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.379525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4ee3-aa5a-41db-9ee3-5915ab9294ef None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.379807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4ee3-aa5a-41db-9ee3-5915ab9294ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.395693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d4ee3-aa5a-41db-9ee3-5915ab9294ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:31.401927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-a30d4ee3-aa5a-41db-9ee3-5915ab9294ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:31.407756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:31.419484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:31.420328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:31.420944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:31.421032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 251/491] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:31.421101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.421101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.421101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.421291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4ee3-aa5a-41db-9ee3-5915ab9294ef None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.421358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:31.423513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:31.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:31.442617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:33:31.443616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:31.446773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 241/492] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:31.447928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.506834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:31.550018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4ee3-aa5a-41db-9ee3-5915ab9294ef None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:31.570191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d2f54-56fc-40fb-9b82-8fa2a7fe0734 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:31.604951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3cba-6d04-43a0-8eae-6b8c52ac040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:31.605758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3cba-6d04-43a0-8eae-6b8c52ac040d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.606051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3cba-6d04-43a0-8eae-6b8c52ac040d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.606374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3cba-6d04-43a0-8eae-6b8c52ac040d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.607978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:31.608769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.609154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.609525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.610407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:31.610818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:31.612333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:31.618828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3cba-6d04-43a0-8eae-6b8c52ac040d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:31.626123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 242/493] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:31.626123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-cb8e3cba-6d04-43a0-8eae-6b8c52ac040d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:31.626894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:31.628000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:31.629046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 252/494] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:31.629907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9b2c-fec7-42a1-a697-ba3c75d28d44 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.629907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9b2c-fec7-42a1-a697-ba3c75d28d44 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.630146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9b2c-fec7-42a1-a697-ba3c75d28d44 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.636158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 253/495] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:31.636905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f9b2c-fec7-42a1-a697-ba3c75d28d44 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.688551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:31.754807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e97fec-de5b-4c41-a1b0-e85fdd4c9cce None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:31.770481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f9b2c-fec7-42a1-a697-ba3c75d28d44 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:31.793928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44170f75-a250-4d1c-b3ec-aab63633aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:31.794659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170f75-a250-4d1c-b3ec-aab63633aff6 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.794941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170f75-a250-4d1c-b3ec-aab63633aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.795215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170f75-a250-4d1c-b3ec-aab63633aff6 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.796050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44170f75-a250-4d1c-b3ec-aab63633aff6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:31.796577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44170f75-a250-4d1c-b3ec-aab63633aff6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:31.798005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44170f75-a250-4d1c-b3ec-aab63633aff6 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:31.806045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:31.813777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:31.815902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.815902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.820440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.832467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:31.834337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:31.848583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 243/496] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:31.849869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036994-25da-4e99-a96a-540e188734b2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.850193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036994-25da-4e99-a96a-540e188734b2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.850483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036994-25da-4e99-a96a-540e188734b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:31.854189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:31.855267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:31.856585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:31.856585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:31.856585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:31.856585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:31.856585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 254/497] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:31.856585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.872626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-5c036994-25da-4e99-a96a-540e188734b2 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:31.873864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5c036994-25da-4e99-a96a-540e188734b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:31.940216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 244/498] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:31.941758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1a97-e30b-435c-b95e-f6da35045d5b None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.941901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1a97-e30b-435c-b95e-f6da35045d5b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.942090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1a97-e30b-435c-b95e-f6da35045d5b None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.946344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 245/499] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:31.946344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa1a97-e30b-435c-b95e-f6da35045d5b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:31.963198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a5cf-55e1-4db1-a758-86c5b76fdf7f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:31.997968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:31.998674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.998956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.999232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.999740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:31.999980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:32.000281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.001668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.010084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 255/500] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:32.010890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.057803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.064352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa1a97-e30b-435c-b95e-f6da35045d5b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.099657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2216a-842a-4a7d-a727-d87e8651ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.100308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2216a-842a-4a7d-a727-d87e8651ee05 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.100593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2216a-842a-4a7d-a727-d87e8651ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.100873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2216a-842a-4a7d-a727-d87e8651ee05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.113989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5ec1e-1ece-4397-ac9b-6ceb76a30400 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.147247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d2317-9993-4bdc-a49b-2e5680a67faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.147903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2317-9993-4bdc-a49b-2e5680a67faa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.148189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2317-9993-4bdc-a49b-2e5680a67faa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.148463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2317-9993-4bdc-a49b-2e5680a67faa None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.149178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d2317-9993-4bdc-a49b-2e5680a67faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:32.149482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d2317-9993-4bdc-a49b-2e5680a67faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.150880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d2317-9993-4bdc-a49b-2e5680a67faa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.162652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 256/501] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:32.163891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbe509-c3a4-450c-96c7-d5b3101dac29 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.164183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbe509-c3a4-450c-96c7-d5b3101dac29 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.164463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbe509-c3a4-450c-96c7-d5b3101dac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.170656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2216a-842a-4a7d-a727-d87e8651ee05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.172128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2216a-842a-4a7d-a727-d87e8651ee05 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.180978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-26dbe509-c3a4-450c-96c7-d5b3101dac29 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:32.182207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-26dbe509-c3a4-450c-96c7-d5b3101dac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:32.213647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.249423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 257/502] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:32.250307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbe509-c3a4-450c-96c7-d5b3101dac29 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.273964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 246/503] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:32.275239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2216a-842a-4a7d-a727-d87e8651ee05 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.287852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.353481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbe509-c3a4-450c-96c7-d5b3101dac29 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.378152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2216a-842a-4a7d-a727-d87e8651ee05 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.388617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7931a33-8f35-4c36-b4ec-ffd0370c31d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.389690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7931a33-8f35-4c36-b4ec-ffd0370c31d5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.389970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7931a33-8f35-4c36-b4ec-ffd0370c31d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.390309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7931a33-8f35-4c36-b4ec-ffd0370c31d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.401107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7931a33-8f35-4c36-b4ec-ffd0370c31d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e7931a33-8f35-4c36-b4ec-ffd0370c31d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:32.408899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:32.415866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 258/504] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:32.416751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7931a33-8f35-4c36-b4ec-ffd0370c31d5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.417482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.417482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.417482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.417482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.423585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.425854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.427368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:32.444696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:32.445783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:32.447188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:32.447188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:32.447188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:32.447188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:32.447188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 247/505] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:32.447188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.512132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.518758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7931a33-8f35-4c36-b4ec-ffd0370c31d5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.553778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.554478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcda2f1-ebcd-4e3e-bf26-674d4e4f09c7 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.554586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.554871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.555151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.562865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.564345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:32.580503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:32.581432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:32.582375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 259/506] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:32.583528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.592716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.593510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.593800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.594076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.604566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.606019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:32.622751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:32.623930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:32.624812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:32.624812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:32.624812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:32.624812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:32.624812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 248/507] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:32.624812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.671465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.683939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39b83e-d746-48bc-808a-2bde2968f75f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.717997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.718813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.719096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.719373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.725981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5767b6-9206-4dc1-a794-628cff2be4b8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.729993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.731498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:32.750225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:32.751272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:32.752647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:32.752647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:32.752647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:32.752647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:32.752647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 260/508] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:32.752647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.766180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.766973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.767346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.767717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.768127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.768622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:32.768785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.770165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.778835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 249/509] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:32.779615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.859785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42858b7-3802-423d-81a8-1e4194b6feff None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.881001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828323-5c30-42c1-8eac-e90d39f3a2a8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.888333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.893645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.894365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.894654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.894936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.895664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:32.895978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.897359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.909700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 261/510] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:32.910543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.916191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.916864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.917152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.917430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.918310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:32.918626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.920072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.938866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 250/511] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:32.939890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.977654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.011229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5f387-856a-48fa-a293-61c976be3d5b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.040005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe2e9d-a25d-4315-af39-226c8b6009fd None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.046030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.046730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.047017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.047304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.048030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:33.048343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.049760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.061784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 262/512] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:33.062611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.075896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.076552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.076831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.077106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.077820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:33.078149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.079521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.090677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 251/513] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:33.091445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.115820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.172856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e05f28-76b2-4337-8c44-5b4f1b759522 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.190268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f933ccd-0e4a-40b7-928e-bcb26faabb9d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.200202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.208229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.209019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.209305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.215478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.220695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.222161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.224614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.225409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.225693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.225967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.233135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.234616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:33.240081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:33.241113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:33.242195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:33.242195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:33.242195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:33.242195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:33.244378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 263/514] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:33.245475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:33.250619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:33.251755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 252/515] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:33.253029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.339531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.351703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480770-b18b-49ee-8367-321a49598dff None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.355316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e062c-c82a-4d74-bb7c-9a6b081e075f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.386393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800edcd-3d72-4738-abe9-cb28bfbe1c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.387042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800edcd-3d72-4738-abe9-cb28bfbe1c99 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.387328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800edcd-3d72-4738-abe9-cb28bfbe1c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.387608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800edcd-3d72-4738-abe9-cb28bfbe1c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.389964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75715436-3160-438d-9c42-a4a8869fec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.390658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75715436-3160-438d-9c42-a4a8869fec88 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.390944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75715436-3160-438d-9c42-a4a8869fec88 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.391226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75715436-3160-438d-9c42-a4a8869fec88 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.391940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75715436-3160-438d-9c42-a4a8869fec88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.393383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75715436-3160-438d-9c42-a4a8869fec88 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.443398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.462495 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800edcd-3d72-4738-abe9-cb28bfbe1c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.464007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800edcd-3d72-4738-abe9-cb28bfbe1c99 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.500656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 253/516] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:33:33 2022] POST /identity/v3/users => generated 247 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:33.501474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75715436-3160-438d-9c42-a4a8869fec88 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.580958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 264/517] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:33.582039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800edcd-3d72-4738-abe9-cb28bfbe1c99 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.624336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75715436-3160-438d-9c42-a4a8869fec88 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.663624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.664427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.664736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.665014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.669896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.673410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.675065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.677867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:33.693241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:33.694359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:33.695238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:33.695238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:33.695238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:33.695238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:33.695238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:33.695238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:33.695238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:33.695238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:33.695664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800edcd-3d72-4738-abe9-cb28bfbe1c99 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.695735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 254/518] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:33.696976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.734428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.735134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.735493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.735663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.736883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:33.736883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.738168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.751261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 265/519] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:33.752011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.822127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821fd7-f4bd-4048-8097-e58b35ba0d13 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.859718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37446444-7a76-40d3-aabb-6624e4f4239b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.861565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.862283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.862571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.862851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.863700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:33.864014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.865460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.891035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 255/520] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:33.891035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.901835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.902667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.902958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.903242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.912565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.914994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.916513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:33.935498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:33.936429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:33.937468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:33.937468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:33.937468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:33.937468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:33.937468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 266/521] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:33.938258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.964003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.009183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef779f-fd65-4b1d-b992-a4164844f494 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.046225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.047131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.047420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.047697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.048479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:34.048787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.050253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.051124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50740c8e-19c5-4873-a81f-67aec5b41d79 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.073679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 256/522] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:34.073679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.095382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.096176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.096458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.096734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.105192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.106664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:34.121341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:34.122298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 267/523] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:34.128385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.185515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.186515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946403b-e9ee-4983-8d66-8befb56802f2 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.205457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.222599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550808-3021-4e8a-9362-ba1397f0bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.223198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550808-3021-4e8a-9362-ba1397f0bb4d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.223482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550808-3021-4e8a-9362-ba1397f0bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.223758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550808-3021-4e8a-9362-ba1397f0bb4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.237175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770495-53c5-4d31-8b9d-a04fcdeb1bb2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.273036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.273703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.273987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.274321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.275043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:34.275352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.276716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.288883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 268/524] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:34.290247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.300885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66550808-3021-4e8a-9362-ba1397f0bb4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.302815 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66550808-3021-4e8a-9362-ba1397f0bb4d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.399921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab967-422d-49bf-a76c-6d06b1b973bd None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.413041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 257/525] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:34.413041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550808-3021-4e8a-9362-ba1397f0bb4d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.414694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.431688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.438436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.439280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.439663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.440040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.441038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=d42bb727957e40dca943c47785819223) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:34.441452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.442921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.448765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 269/526] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/role_assignments?user.id=d42bb727957e40dca943c47785819223&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:34.449571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.526878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550808-3021-4e8a-9362-ba1397f0bb4d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.565546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.566504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.567047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.567479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.568578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:34.569048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.570716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.585667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe8488-e922-4d1a-a73e-fafed66b05d7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.596106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 258/527] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:34.597299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.638138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.638138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.638138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.638138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.646736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.648854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:34.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:34.675377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:34.676604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:34.676604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:34.676604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:34.676604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:34.676604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:34.676604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:34.676604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:34.676604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:34.680432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 270/528] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:34.680432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.691955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.714373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa7742-cae7-49ec-add9-9c44974c9c65 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.727188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.767775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.769106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.769564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.770628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.791071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.792569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.808333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff94889-bd0b-488c-ab8b-c10588dcc30b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:34.811634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:34.812723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:34.813843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:34.813843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:34.813843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:34.813843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:34.814422 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 259/529] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:34.815367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.857321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e05c89-4ed7-4a00-9732-02a87aec283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.857977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e05c89-4ed7-4a00-9732-02a87aec283a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.858292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e05c89-4ed7-4a00-9732-02a87aec283a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.858572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e05c89-4ed7-4a00-9732-02a87aec283a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.929579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e05c89-4ed7-4a00-9732-02a87aec283a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.931146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e05c89-4ed7-4a00-9732-02a87aec283a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.940152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef7e9-d20d-4310-8f71-184aa70ab4ec None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.968594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.971225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.979770 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.980783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.981218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.985931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.985931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:34.985931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.985931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.002211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 260/530] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:35.003288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.045270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 271/531] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:35.046038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e05c89-4ed7-4a00-9732-02a87aec283a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.136485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc3016-3fca-4cd1-afd1-047b488ebcc2 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.153193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e05c89-4ed7-4a00-9732-02a87aec283a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.183965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.185297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.185908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.186473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.187347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:35.187872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.189473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.190021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.190710 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.190993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.191269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.192098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=035eeee0a72449358827a34bb09aa057) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:35.192411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.193832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.196856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:35.204367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 261/532] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:35.205447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.205826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 272/533] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/role_assignments?user.id=035eeee0a72449358827a34bb09aa057&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:35.210492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.268388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:35.339742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2879d-f81b-4174-bb30-1b41ec8b9233 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.380870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.381938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.382411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.382828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.397087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.399970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:35.421735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:35.423275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:35.424338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:35.424338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:35.424338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:35.424338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:35.427172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 262/534] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:35.433053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.468172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d80739-501c-4843-a96f-1fb49147aa1f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.530095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.531400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.532942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.533459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.551335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.553154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:35.574956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:35.575904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:35.576847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:35.576847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:35.576847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:35.576847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:35.576847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:35.576847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:35.576847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:35.576847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:35.579512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 273/535] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:35.584835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.649783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:35.655962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950fc69-6fde-4551-b85e-006781bd5644 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.701623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:35.709256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4edb68-d6bb-4793-b604-821c558db0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.710667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4edb68-d6bb-4793-b604-821c558db0c1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.711402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4edb68-d6bb-4793-b604-821c558db0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.712500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4edb68-d6bb-4793-b604-821c558db0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.713582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4edb68-d6bb-4793-b604-821c558db0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:35.714911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4edb68-d6bb-4793-b604-821c558db0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.716889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4edb68-d6bb-4793-b604-821c558db0c1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.732295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 263/536] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:35.738451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004959-9991-41a3-8286-3293836d5cf5 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.738967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004959-9991-41a3-8286-3293836d5cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.739414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004959-9991-41a3-8286-3293836d5cf5 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.741175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 264/537] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:35.742078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004959-9991-41a3-8286-3293836d5cf5 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.764158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9ebe6-db4f-4731-8c5c-5d8fcbab73f9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.800444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58cd7-c2a1-41fa-9fea-7e152c93ec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.801131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58cd7-c2a1-41fa-9fea-7e152c93ec3c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.801660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58cd7-c2a1-41fa-9fea-7e152c93ec3c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.801861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58cd7-c2a1-41fa-9fea-7e152c93ec3c None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.802697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58cd7-c2a1-41fa-9fea-7e152c93ec3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:35.803045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58cd7-c2a1-41fa-9fea-7e152c93ec3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.804472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58cd7-c2a1-41fa-9fea-7e152c93ec3c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.824917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 274/538] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:35.826300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018944a0-5d23-4657-8e64-8845aea22e13 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.826592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018944a0-5d23-4657-8e64-8845aea22e13 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.826872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018944a0-5d23-4657-8e64-8845aea22e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.846874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-018944a0-5d23-4657-8e64-8845aea22e13 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:35.848375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-018944a0-5d23-4657-8e64-8845aea22e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:35.871489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004959-9991-41a3-8286-3293836d5cf5 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.915485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.916733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.917295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.917715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.925408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.926512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 275/539] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:35.927214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.927617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018944a0-5d23-4657-8e64-8845aea22e13 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:35.945127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:35.946767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:35.947664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:35.947664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:35.947664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:35.947664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:35.947664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:35.947664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:35.947664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:35.947664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:35.954815 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 265/540] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:35.956139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.984148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:36.007208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:36.068851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018944a0-5d23-4657-8e64-8845aea22e13 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:36.089259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c01b9-c1eb-404d-938b-e5ef1c156de0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:36.110904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:36.111841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.112265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.112692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.113672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=96a80e224da849e19538182793f13e10) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:36.114258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:36.115904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:36.123300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 276/541] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/role_assignments?user.id=96a80e224da849e19538182793f13e10&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:36.124457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:36.131389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:36.132288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.132637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.132977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.134470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:36.134853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:36.137122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:36.152931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 266/542] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:36.159050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:36.247202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:36.249131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026e34-1d3d-4832-8279-2ed4747e25ea None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:36.267451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:36.268282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf5627-971c-491f-bbd8-42591e75acd0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:36.291519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249f50-4cf7-4683-995c-45251a7a294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:36.292721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249f50-4cf7-4683-995c-45251a7a294b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.293467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249f50-4cf7-4683-995c-45251a7a294b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.296857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249f50-4cf7-4683-995c-45251a7a294b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.306270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:36.306987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.307274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.307569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.308383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=092f588c7472454c8a6f435525e40a2c) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:36.308638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2249f50-4cf7-4683-995c-45251a7a294b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:36.308738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:36.310161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:36.316727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 267/543] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:36 2022] GET /identity/v3/role_assignments?user.id=092f588c7472454c8a6f435525e40a2c&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-b2249f50-4cf7-4683-995c-45251a7a294b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:36.318623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:36.319509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:36.320332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:36.323824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 277/544] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:36.330364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:36.478323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0cffe-bed9-4d74-9730-58ad6c1c111a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:36.540760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba96fd-65e8-4418-aace-ed97f5638232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:36.541882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba96fd-65e8-4418-aace-ed97f5638232 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.542383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba96fd-65e8-4418-aace-ed97f5638232 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.542851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba96fd-65e8-4418-aace-ed97f5638232 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.543879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba96fd-65e8-4418-aace-ed97f5638232 None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:36.544427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba96fd-65e8-4418-aace-ed97f5638232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:36.546002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba96fd-65e8-4418-aace-ed97f5638232 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:36.556435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 268/545] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:36.562487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249f50-4cf7-4683-995c-45251a7a294b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:36.673572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6107c0e-e40f-416c-ac49-f05f93c86ca0 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.673858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6107c0e-e40f-416c-ac49-f05f93c86ca0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.674149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6107c0e-e40f-416c-ac49-f05f93c86ca0 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.676075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 269/546] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:36.677111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249f50-4cf7-4683-995c-45251a7a294b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:36.683579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f656-78ff-4d88-b458-8d0eefd0efac None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.683861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f656-78ff-4d88-b458-8d0eefd0efac None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.684140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f656-78ff-4d88-b458-8d0eefd0efac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.700169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:36.707735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4787f656-78ff-4d88-b458-8d0eefd0efac None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:36.709749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4787f656-78ff-4d88-b458-8d0eefd0efac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:36.746843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:36.747668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.747956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.748235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.775534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:36.777183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:36.814238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:36.815205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:36.816102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:36.816102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:36.816102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:36.816102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:36.816102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 278/547] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:36.820193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:36.831837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 270/548] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:36.858301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787f656-78ff-4d88-b458-8d0eefd0efac None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:36.866685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:36.948646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7f92f-6568-4315-b8aa-d3e0e056fc76 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:36.987992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:36.988658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:36.988938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:36.989215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:36.990118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:36.990436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:36.992234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:37.006571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 279/549] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:37.015135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.128105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dc643-78ca-4436-9e32-4b698da1b6a6 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:37.130407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:37.147084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787f656-78ff-4d88-b458-8d0eefd0efac None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:37.194934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eccaa-8e94-40e2-9ebe-b746601b44ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:37.195812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eccaa-8e94-40e2-9ebe-b746601b44ed None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.196702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eccaa-8e94-40e2-9ebe-b746601b44ed None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.196974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eccaa-8e94-40e2-9ebe-b746601b44ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.202094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:37.218817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18eccaa-8e94-40e2-9ebe-b746601b44ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:37.222721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:37.223525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.223809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.224082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-e18eccaa-8e94-40e2-9ebe-b746601b44ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:37.237549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:37.238601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:37.239444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:37.240100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:37.246419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:37.246650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 271/550] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:37.249351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eccaa-8e94-40e2-9ebe-b746601b44ed None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:37.272519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:37.273696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:33:37.275242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:37.279806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 280/551] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:37.286140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.462562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eccaa-8e94-40e2-9ebe-b746601b44ed None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:37.462910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484454d-0d48-4b50-a79a-284e1e9454e8 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:37.498216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0997f0-09a6-4b0e-862b-d4b850a27ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:37.498904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0997f0-09a6-4b0e-862b-d4b850a27ee0 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.499190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0997f0-09a6-4b0e-862b-d4b850a27ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.499469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0997f0-09a6-4b0e-862b-d4b850a27ee0 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.500320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0997f0-09a6-4b0e-862b-d4b850a27ee0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:37.500633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0997f0-09a6-4b0e-862b-d4b850a27ee0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:37.502089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0997f0-09a6-4b0e-862b-d4b850a27ee0 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:37.535189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72979af6-609a-495d-9901-02a2ddaeaf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:37.535871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979af6-609a-495d-9901-02a2ddaeaf5e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.536158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979af6-609a-495d-9901-02a2ddaeaf5e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.536437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979af6-609a-495d-9901-02a2ddaeaf5e None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.537386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979af6-609a-495d-9901-02a2ddaeaf5e None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:37.537830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979af6-609a-495d-9901-02a2ddaeaf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:37.539251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979af6-609a-495d-9901-02a2ddaeaf5e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:37.540914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 281/552] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:37.546586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc542-8301-4a45-ab66-210b13ca7fbb None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.546903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc542-8301-4a45-ab66-210b13ca7fbb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.547192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc542-8301-4a45-ab66-210b13ca7fbb None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.548749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 282/554] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:37.549489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc542-8301-4a45-ab66-210b13ca7fbb None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.552618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 272/554] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:37.553627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:37.556122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42f797-6b06-4d3a-9056-37b359eba409 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.556420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42f797-6b06-4d3a-9056-37b359eba409 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.556700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42f797-6b06-4d3a-9056-37b359eba409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.579021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3b42f797-6b06-4d3a-9056-37b359eba409 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:37.580876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3b42f797-6b06-4d3a-9056-37b359eba409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:37.650555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:37.662487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 273/555] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:37.663717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42f797-6b06-4d3a-9056-37b359eba409 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.682828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc542-8301-4a45-ab66-210b13ca7fbb None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:37.726257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f591d-4b83-4b10-b1ae-0ddf94470ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:37.726840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f591d-4b83-4b10-b1ae-0ddf94470ce7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.727123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f591d-4b83-4b10-b1ae-0ddf94470ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.727428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f591d-4b83-4b10-b1ae-0ddf94470ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.771598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42f797-6b06-4d3a-9056-37b359eba409 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:37.805799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f591d-4b83-4b10-b1ae-0ddf94470ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:37.807402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f591d-4b83-4b10-b1ae-0ddf94470ce7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:37.808272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:37.809140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.809490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.809827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.810366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:37.820972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:37.823067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:37.841733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:37.842971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:37.844016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:37.844016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:37.844016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:37.844016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:37.844568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 274/556] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:37.845234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.897808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:37.923943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 283/557] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:37.925156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f591d-4b83-4b10-b1ae-0ddf94470ce7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.960288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e856954-63fe-4b97-8499-fdd6bee525c6 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.000342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17cc1-dded-4fca-9ef7-2e3ea3fe1e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.001115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17cc1-dded-4fca-9ef7-2e3ea3fe1e3d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.002051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17cc1-dded-4fca-9ef7-2e3ea3fe1e3d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.002051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17cc1-dded-4fca-9ef7-2e3ea3fe1e3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.012676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd17cc1-dded-4fca-9ef7-2e3ea3fe1e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-7dd17cc1-dded-4fca-9ef7-2e3ea3fe1e3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:38.021209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:38.022900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 275/558] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:38.023738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17cc1-dded-4fca-9ef7-2e3ea3fe1e3d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.037920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f591d-4b83-4b10-b1ae-0ddf94470ce7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.041636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.076301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.077151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.077811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.078519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.079659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:38.079948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.081733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.098823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 284/559] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:38.098823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.139841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.143076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17cc1-dded-4fca-9ef7-2e3ea3fe1e3d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.181775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.183344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.183856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.184332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.196848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.198838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.208213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72608550-6afd-4781-8ead-d8b1fd0d8408 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:38.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:38.221094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:38.222020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:38.222020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:38.222020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:38.222020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:38.229407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 276/560] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:38.230671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.245063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.245817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.246184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.246411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.247228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:38.247540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.249070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.258819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 285/561] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:38.259749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.291135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.344772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2138e-3cf8-462f-8e69-33c28c180f1d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.370892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e16e74-c8cb-47fa-82b5-457c7420d80c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.383712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.384920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.385491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.385992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] PATH_INFO: `/v3/users/glance` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.394915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.396819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.409273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.410021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.410421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.410810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.411619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:38.411992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.413437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:38.416155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:38.417119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:33:38.418074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:38.424757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 277/562] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:38.427184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.428661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 286/563] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:38.429558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.449110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.618705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.626220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a51e95-a013-4035-9c4d-66f07d9ac4fe None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.637982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7fae-35aa-4811-a874-eb49b7589d6b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.665743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.666575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.666859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.667313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.679881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.681690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.683577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4711-9a73-4d25-aeeb-95fcc3587c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.684259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4711-9a73-4d25-aeeb-95fcc3587c03 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.684548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4711-9a73-4d25-aeeb-95fcc3587c03 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.684832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4711-9a73-4d25-aeeb-95fcc3587c03 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.685675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e4711-9a73-4d25-aeeb-95fcc3587c03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:38.685989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e4711-9a73-4d25-aeeb-95fcc3587c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.687510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e4711-9a73-4d25-aeeb-95fcc3587c03 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:38.700652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:38.701589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:38.707447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:38.707447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:38.707447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:38.707447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:38.707447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 278/564] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:38.707447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.713249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 287/565] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:38.714780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c284d-e18a-4437-9ff8-1d71add7a83c None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.715071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c284d-e18a-4437-9ff8-1d71add7a83c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.715383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c284d-e18a-4437-9ff8-1d71add7a83c None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.716622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 288/566] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:38.717317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c284d-e18a-4437-9ff8-1d71add7a83c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.775291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.812515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463fdf-2f84-4386-8848-be8ff58e9a2e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.825631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c284d-e18a-4437-9ff8-1d71add7a83c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.847494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789410e-474c-43c5-8787-7e35ca21dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.848281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789410e-474c-43c5-8787-7e35ca21dbbc None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.848559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789410e-474c-43c5-8787-7e35ca21dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.848843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789410e-474c-43c5-8787-7e35ca21dbbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.855365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789410e-474c-43c5-8787-7e35ca21dbbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.856790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789410e-474c-43c5-8787-7e35ca21dbbc None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.860668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e24f4-c595-4e33-82e7-046b1c79143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.861324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e24f4-c595-4e33-82e7-046b1c79143d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.861607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e24f4-c595-4e33-82e7-046b1c79143d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.861885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e24f4-c595-4e33-82e7-046b1c79143d None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.862633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e24f4-c595-4e33-82e7-046b1c79143d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:38.862949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e24f4-c595-4e33-82e7-046b1c79143d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.864298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e24f4-c595-4e33-82e7-046b1c79143d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-f789410e-474c-43c5-8787-7e35ca21dbbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:38.871081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:38.872106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:38.873021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 279/567] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:38.873522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b2a6-b3dd-4b93-b3b9-593a174c1537 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.873659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b2a6-b3dd-4b93-b3b9-593a174c1537 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.873927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b2a6-b3dd-4b93-b3b9-593a174c1537 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.875365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 280/568] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:38.876039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966b2a6-b3dd-4b93-b3b9-593a174c1537 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.880667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 289/569] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:38.881930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865007-e064-4c8c-85b6-8612b4134aaf None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.882241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865007-e064-4c8c-85b6-8612b4134aaf None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.882522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865007-e064-4c8c-85b6-8612b4134aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.890724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.901872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-58865007-e064-4c8c-85b6-8612b4134aaf None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:38.903113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-58865007-e064-4c8c-85b6-8612b4134aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:38.970014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 290/570] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:38.971051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58865007-e064-4c8c-85b6-8612b4134aaf None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.991121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966b2a6-b3dd-4b93-b3b9-593a174c1537 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.016405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.026816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e485d-a84d-4894-b39c-041472b198d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.027603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e485d-a84d-4894-b39c-041472b198d9 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.027891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e485d-a84d-4894-b39c-041472b198d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.028174 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e485d-a84d-4894-b39c-041472b198d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.038010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e485d-a84d-4894-b39c-041472b198d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.039498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e485d-a84d-4894-b39c-041472b198d9 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-c83e485d-a84d-4894-b39c-041472b198d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:39.058281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:39.059280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:39.060185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:39.060185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:39.060185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:39.060185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:39.060185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 281/571] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:39.060735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3afb4-f3e2-43d3-ab6d-b0d467f8f9ce None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.061019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3afb4-f3e2-43d3-ab6d-b0d467f8f9ce None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.061288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3afb4-f3e2-43d3-ab6d-b0d467f8f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.079451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a1d3afb4-f3e2-43d3-ab6d-b0d467f8f9ce None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:39.080665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a1d3afb4-f3e2-43d3-ab6d-b0d467f8f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:39.080852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58865007-e064-4c8c-85b6-8612b4134aaf None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.114374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.115037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.115349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.115595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.116385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:39.116699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.118692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.120343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.134541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 291/572] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:39.134541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.149571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 282/573] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:39.150439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3afb4-f3e2-43d3-ab6d-b0d467f8f9ce None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.247993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c7081-a3b2-44d7-85c3-1c12d27310ce None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.250809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3afb4-f3e2-43d3-ab6d-b0d467f8f9ce None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.258238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.283019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.283817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.284107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.284391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.285331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d5663-75ac-4cc8-b752-ae4652ab8dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.286183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d5663-75ac-4cc8-b752-ae4652ab8dd3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.286473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d5663-75ac-4cc8-b752-ae4652ab8dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.286754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d5663-75ac-4cc8-b752-ae4652ab8dd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.292396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.293861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.297513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d5663-75ac-4cc8-b752-ae4652ab8dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ba7d5663-75ac-4cc8-b752-ae4652ab8dd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:39.305220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:39.306724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:39.307572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 283/574] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:39.308293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d5663-75ac-4cc8-b752-ae4652ab8dd3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:39.308542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:39.310217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 292/575] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:39.312277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.370242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.416297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b12ea-6ff0-45d8-ad8b-c9aba41de939 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.418710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d5663-75ac-4cc8-b752-ae4652ab8dd3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.450642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.451299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.451589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.451867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.452697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=0c3a489751424d008dbfefa89d19883a) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:39.453014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.454358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.454547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.455035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.455328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.455611 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.456332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:39.456644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.458007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.460036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 293/576] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/role_assignments?user.id=0c3a489751424d008dbfefa89d19883a&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:39.460821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.484058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 284/577] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:39.484817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.518580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.582998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469901f2-edc2-4a80-8fe7-c922a97ea20d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.604066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.611309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6d82-c9c0-42f9-b6da-a85e87eaa5d3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.623227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79301006-278d-4ebb-a4a6-f878fe0e4bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.624927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301006-278d-4ebb-a4a6-f878fe0e4bb6 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.624927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301006-278d-4ebb-a4a6-f878fe0e4bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.625146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301006-278d-4ebb-a4a6-f878fe0e4bb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.637846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79301006-278d-4ebb-a4a6-f878fe0e4bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-79301006-278d-4ebb-a4a6-f878fe0e4bb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:39.646006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:39.647023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:39.647948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 294/578] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:39.648653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79301006-278d-4ebb-a4a6-f878fe0e4bb6 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.657715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.658445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.658770 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.659060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.659814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:39.660127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.661494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.669983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 285/579] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:39.670752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.775444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.781329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79301006-278d-4ebb-a4a6-f878fe0e4bb6 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.792474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bc25-58fc-4e70-ac1e-e87dad452753 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.818851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.819521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.819802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.820076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.820970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:39.821902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.823355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.825030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.825821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.826130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.826408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.833482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.834924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.846480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 295/580] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:39.846480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:39.848716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:39.849636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 286/581] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:39.850717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.893148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.965519 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff434e2f-1b57-46c0-bb9d-481d14864cf8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.968584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6d715-1248-4849-aa86-92e6f2b78227 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.001237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.002178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.002499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.002779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.007258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.007926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.008212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.009093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.009861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:40.010548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.011567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.015107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.016527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.025250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 296/582] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:40.025250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.025515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:40.035033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:40.039228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:40.040189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:40.040189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:40.040189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:40.040189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:40.040189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 287/583] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:40.040189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.139321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:40.143481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcb0ca-7468-46fd-a380-a9bc6459c910 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.148002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7bdab-ba5d-4118-aa45-08b919e7b0af None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.180985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.181956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.182718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.183254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.185574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.186279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.186894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.187186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.187980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:40.188295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.190141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.195594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.197300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.204822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 288/584] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:40.205686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:40.216752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:40.217678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:40.218676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:40.218676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:40.218676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:40.218676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:40.225552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 297/585] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:40.225552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.278667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:40.328359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26da29-cd47-461a-ad80-cd328bdccd26 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.328586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcd19a-51e3-4682-9572-36f1ee969e71 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.363419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.364215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.364499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.364775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.365327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.365990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.366311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.366705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.367618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:40.368428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.369793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.375475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.376909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.381981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 298/586] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:40.383060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:40.398840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:40.399808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:40.400714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:40.400714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:40.400714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:40.400714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:40.400953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:40.401368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 289/587] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:40.401368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.497119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b108bf-72bc-439b-9029-fc06395ec590 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.532037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff2a8e-c343-4639-af11-fe03ecde1825 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.532376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af11245-eb2f-4f88-819d-cd64200d1a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.533262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11245-eb2f-4f88-819d-cd64200d1a6b None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.533546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11245-eb2f-4f88-819d-cd64200d1a6b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.533820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11245-eb2f-4f88-819d-cd64200d1a6b None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/d42bb727957e40dca943c47785819223/roles/af9f77c3be4c47969788085eedea854d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.546151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:40.549836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af11245-eb2f-4f88-819d-cd64200d1a6b None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=d42bb727957e40dca943c47785819223, role_id=af9f77c3be4c47969788085eedea854d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.551357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af11245-eb2f-4f88-819d-cd64200d1a6b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.568792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.569477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.569762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.570040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.570806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:40.571146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.572612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.585361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 290/588] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:40.592706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.649924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 299/589] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:40 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/d42bb727957e40dca943c47785819223/roles/af9f77c3be4c47969788085eedea854d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:40.649924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af11245-eb2f-4f88-819d-cd64200d1a6b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.714754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60335a09-578f-4e5c-bd9b-fed68048aeaa None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.725372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:40.761751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.762602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.762943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.763224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.772211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.772676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af11245-eb2f-4f88-819d-cd64200d1a6b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.774716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:40.792552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:40.793896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:33:40.795031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:40.797316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 291/590] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:40.798413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.820151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.820826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.821656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.821937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.822707 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:40.823020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.824923 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.835293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:40.838437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 300/591] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:40.839269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:40.934254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9cb5c-10ea-4086-a2a2-cef0f6f51e8d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.967645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c4694-f243-477a-95f2-8d42e12bf6b3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:40.971435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:40.972468 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:40.972753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:40.973080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:40.980856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:40.982355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:40.992524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:40.997282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:40.998229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:40.999146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:40.999146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:40.999146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:40.999146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:40.999146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:40.999146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:40.999146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:40.999146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:41.002261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 292/592] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:41.003488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.013599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:41.014927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.015408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.016444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.017490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:41.018514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:41.020845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:41.042755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 301/593] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jul 11 14:33:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:41.043679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.125458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:41.135578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd840a0-8734-48e4-8049-4ec319f6bcf5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:41.152496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4cad-6773-4c3f-996d-bf9086ebf9bd None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:41.175028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:41.176206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.176688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.177158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.186033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:41.187978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:41.191368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:41.191368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.191368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.191368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.193141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:41.193558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:41.195175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:41.207656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:41.208662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:33:41.209617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:41.212279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 293/594] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:41.213069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 302/595] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:41.213396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.219452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.264230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:41.341028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff758ea1-c67b-483b-b790-b6774cc09d03 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:41.352030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eefc0e-b7b3-45bb-bd2f-531af84a21c7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:41.384839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:41.385896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.386211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.386493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.402329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:41.404731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:41.413499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289e822-c2cb-4621-a7a2-42eb52020013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:41.416593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e822-c2cb-4621-a7a2-42eb52020013 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.416593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e822-c2cb-4621-a7a2-42eb52020013 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.416593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e822-c2cb-4621-a7a2-42eb52020013 None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/035eeee0a72449358827a34bb09aa057/roles/af9f77c3be4c47969788085eedea854d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:41.429947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:41.431081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:41.431993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:41.431993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:41.431993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:41.431993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:41.432216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289e822-c2cb-4621-a7a2-42eb52020013 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=035eeee0a72449358827a34bb09aa057, role_id=af9f77c3be4c47969788085eedea854d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:41.433014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289e822-c2cb-4621-a7a2-42eb52020013 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:41.434554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 294/596] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:41.435904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.440775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:41.540939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760b193-7b69-4247-b5ef-e9aac95fcce6 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:41.550421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 303/597] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:41 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/035eeee0a72449358827a34bb09aa057/roles/af9f77c3be4c47969788085eedea854d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:33:41.550421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289e822-c2cb-4621-a7a2-42eb52020013 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.597383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471412d-1bce-48ad-a5e0-db080fb01faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:41.598412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471412d-1bce-48ad-a5e0-db080fb01faf None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.598694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471412d-1bce-48ad-a5e0-db080fb01faf None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.598966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471412d-1bce-48ad-a5e0-db080fb01faf None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.599819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471412d-1bce-48ad-a5e0-db080fb01faf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:41.600187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471412d-1bce-48ad-a5e0-db080fb01faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:41.602220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471412d-1bce-48ad-a5e0-db080fb01faf None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:41.626030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 295/598] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:41.627544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9997a-5665-4a73-832d-024959a70611 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.627844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9997a-5665-4a73-832d-024959a70611 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.628103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9997a-5665-4a73-832d-024959a70611 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.634781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 296/599] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:41.635737 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9997a-5665-4a73-832d-024959a70611 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.665526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:41.680893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289e822-c2cb-4621-a7a2-42eb52020013 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:41.720226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:41.723891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278be49-75d0-40ad-b67e-26be96f566e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:41.724561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278be49-75d0-40ad-b67e-26be96f566e4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.724850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278be49-75d0-40ad-b67e-26be96f566e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.725117 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278be49-75d0-40ad-b67e-26be96f566e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.725838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278be49-75d0-40ad-b67e-26be96f566e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:41.726207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278be49-75d0-40ad-b67e-26be96f566e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:41.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278be49-75d0-40ad-b67e-26be96f566e4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:41.743107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 304/600] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:41.744419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea0164-554a-4a8c-9a85-dcc236dc71cc None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.751789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea0164-554a-4a8c-9a85-dcc236dc71cc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.751789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea0164-554a-4a8c-9a85-dcc236dc71cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.767915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c1ea0164-554a-4a8c-9a85-dcc236dc71cc None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:41.769224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c1ea0164-554a-4a8c-9a85-dcc236dc71cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:41.776852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9997a-5665-4a73-832d-024959a70611 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:41.817277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:41.818566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.818851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.819129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.834887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:41.837585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:41.849032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 305/601] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:41.850000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea0164-554a-4a8c-9a85-dcc236dc71cc None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:41.860215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:41.861213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:41.862267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:41.862267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:41.862267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:41.862267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:41.862267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 297/602] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:41.879529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.959937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:41.987906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea0164-554a-4a8c-9a85-dcc236dc71cc None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.003663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47d7d-dfc7-4b87-a5d5-8bcd73fccf84 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.024846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.037494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.038607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.038888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.039163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.047924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.049424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440db9e7-4654-416f-b6c5-e94b9b9ddbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.049570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.050747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db9e7-4654-416f-b6c5-e94b9b9ddbe5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.051459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db9e7-4654-416f-b6c5-e94b9b9ddbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.051947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db9e7-4654-416f-b6c5-e94b9b9ddbe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.064725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440db9e7-4654-416f-b6c5-e94b9b9ddbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:42.067819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:42.068701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:42.069596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 306/603] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:42.070085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-440db9e7-4654-416f-b6c5-e94b9b9ddbe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:42.077792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:42.078780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:42.079629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:42.083586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 298/604] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:42.089696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440db9e7-4654-416f-b6c5-e94b9b9ddbe5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.217602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c0e7e-93fd-4926-b204-975123570632 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.225434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440db9e7-4654-416f-b6c5-e94b9b9ddbe5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.255566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.256632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.257220 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.257706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.259314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:42.259871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.261590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.267618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.268438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.268723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.268998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.269783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:42.270092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.271257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.271689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.278414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 307/605] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:42.279517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.292950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 299/606] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:42.294165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.339478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.394314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0e6f4-19b7-4222-9369-f566fdfa94b5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.429258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b788d-1f9e-447a-971f-db26462351b5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.434138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.435091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.435584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.436092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.437420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:42.438002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.439744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.454071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 308/607] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:42.455522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.469031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.469828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.470131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.470887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.480948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.482972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:42.502271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:42.503228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:42.504284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:42.504284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:42.504284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:42.504284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:42.504284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:42.504284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:42.504284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:42.504284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:42.510205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 300/608] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:42.511185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.531672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.586245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b6d3-7a54-4e79-a218-ea066b3530c9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.624438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.632416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead27cf-22ae-482b-9633-3f061fd0dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.633332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead27cf-22ae-482b-9633-3f061fd0dbd7 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.638650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead27cf-22ae-482b-9633-3f061fd0dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.638650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead27cf-22ae-482b-9633-3f061fd0dbd7 None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/96a80e224da849e19538182793f13e10/roles/af9f77c3be4c47969788085eedea854d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.639125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3c9ad-a300-4afd-b237-1b4ab418b88a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.651432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead27cf-22ae-482b-9633-3f061fd0dbd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=96a80e224da849e19538182793f13e10, role_id=af9f77c3be4c47969788085eedea854d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.653194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead27cf-22ae-482b-9633-3f061fd0dbd7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.682330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.683505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.683982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.684449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.696642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.698206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:42.717058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:42.717987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:42.719087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:42.719087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:42.719087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:42.719087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:42.722887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 301/609] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:42.723808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.780651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 309/610] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:42 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/96a80e224da849e19538182793f13e10/roles/af9f77c3be4c47969788085eedea854d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:42.782543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead27cf-22ae-482b-9633-3f061fd0dbd7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.849646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac12a-15eb-4c7b-b5b8-d3f9d077e80e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.890800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a789263-17c3-4893-bea2-abba925660d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.891329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a789263-17c3-4893-bea2-abba925660d4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.891612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a789263-17c3-4893-bea2-abba925660d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.891887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a789263-17c3-4893-bea2-abba925660d4 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.892695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a789263-17c3-4893-bea2-abba925660d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:42.893008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a789263-17c3-4893-bea2-abba925660d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.894642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a789263-17c3-4893-bea2-abba925660d4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.914044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 302/611] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:42.916183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919c6a-1443-4c71-8f99-2274fcf0bf72 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.916475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919c6a-1443-4c71-8f99-2274fcf0bf72 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.916754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919c6a-1443-4c71-8f99-2274fcf0bf72 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.922633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 303/612] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:42.923840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919c6a-1443-4c71-8f99-2274fcf0bf72 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.934481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.937055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead27cf-22ae-482b-9633-3f061fd0dbd7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.951241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.978535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69181b07-38f7-4ec9-8dea-5c20a42e5790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.979207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69181b07-38f7-4ec9-8dea-5c20a42e5790 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.979493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69181b07-38f7-4ec9-8dea-5c20a42e5790 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.979775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69181b07-38f7-4ec9-8dea-5c20a42e5790 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.980507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69181b07-38f7-4ec9-8dea-5c20a42e5790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:42.980872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69181b07-38f7-4ec9-8dea-5c20a42e5790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.982281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69181b07-38f7-4ec9-8dea-5c20a42e5790 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.995997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 310/613] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:42.997302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f507b-660f-41c4-8066-216b29f41e22 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.997655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f507b-660f-41c4-8066-216b29f41e22 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.997988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f507b-660f-41c4-8066-216b29f41e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.022592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9c5f507b-660f-41c4-8066-216b29f41e22 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:43.027559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9c5f507b-660f-41c4-8066-216b29f41e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:43.045627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919c6a-1443-4c71-8f99-2274fcf0bf72 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.085602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cecd3-9408-4188-b3e3-e4107a495bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.087085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cecd3-9408-4188-b3e3-e4107a495bcd None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.087377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cecd3-9408-4188-b3e3-e4107a495bcd None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.087649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cecd3-9408-4188-b3e3-e4107a495bcd None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/092f588c7472454c8a6f435525e40a2c/roles/af9f77c3be4c47969788085eedea854d` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.102470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cecd3-9408-4188-b3e3-e4107a495bcd None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=092f588c7472454c8a6f435525e40a2c, role_id=af9f77c3be4c47969788085eedea854d)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.103927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cecd3-9408-4188-b3e3-e4107a495bcd None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.110586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 311/614] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:43.111491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f507b-660f-41c4-8066-216b29f41e22 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.177360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 304/615] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:42 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/092f588c7472454c8a6f435525e40a2c/roles/af9f77c3be4c47969788085eedea854d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:43.178422 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cecd3-9408-4188-b3e3-e4107a495bcd None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.243774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.248510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f507b-660f-41c4-8066-216b29f41e22 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.286488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.343014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.344017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.344305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.344584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] PATH_INFO: `/v3/users/swift` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.352887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.354380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:43.369752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:43.370804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:43.372372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 312/616] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:43.377127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.381345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cecd3-9408-4188-b3e3-e4107a495bcd None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.430884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30179f-e15b-4063-8e0b-bc4a1ae07da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.432277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30179f-e15b-4063-8e0b-bc4a1ae07da1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.432786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30179f-e15b-4063-8e0b-bc4a1ae07da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.433265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30179f-e15b-4063-8e0b-bc4a1ae07da1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.453169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30179f-e15b-4063-8e0b-bc4a1ae07da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-2f30179f-e15b-4063-8e0b-bc4a1ae07da1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:43.466321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:43.467334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:43.468536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 305/617] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:43.474874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30179f-e15b-4063-8e0b-bc4a1ae07da1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.513168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b75f-9aa7-41f7-99a8-4513e1df2c1a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.552308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.553350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.553837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.554347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.556168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:43.556783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.558513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.582844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30179f-e15b-4063-8e0b-bc4a1ae07da1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.586974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 313/618] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:43.592385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.600939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.620007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.620684 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.620970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.621250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.621979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.622091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:43.622325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.624015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.634347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 306/619] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:43.644899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.730614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace5d2a-4b7f-438a-a3f9-badf23285afb None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.762781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6caa5-d3ee-4a31-b26d-41994826d03d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.771484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d043-d6b0-4fb3-9ae8-ef260d8f4653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.773177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d043-d6b0-4fb3-9ae8-ef260d8f4653 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.773874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d043-d6b0-4fb3-9ae8-ef260d8f4653 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.774462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d043-d6b0-4fb3-9ae8-ef260d8f4653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.786010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1d043-d6b0-4fb3-9ae8-ef260d8f4653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.787810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1d043-d6b0-4fb3-9ae8-ef260d8f4653 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-f8b1d043-d6b0-4fb3-9ae8-ef260d8f4653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:43.807196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:43.808196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:43.809139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:43.809139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:43.809139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:43.809139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:43.811486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 314/620] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:43.813092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f131-95b0-4a82-b6e6-a197a3fefd52 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.813623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f131-95b0-4a82-b6e6-a197a3fefd52 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.814118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f131-95b0-4a82-b6e6-a197a3fefd52 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.815880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 315/621] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:43.817062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47f131-95b0-4a82-b6e6-a197a3fefd52 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.817492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6f4fa-0842-4f3b-98a9-e91fd8b2ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.818318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6f4fa-0842-4f3b-98a9-e91fd8b2ff9d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.818628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6f4fa-0842-4f3b-98a9-e91fd8b2ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.818981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6f4fa-0842-4f3b-98a9-e91fd8b2ff9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.830919 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6f4fa-0842-4f3b-98a9-e91fd8b2ff9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.832377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6f4fa-0842-4f3b-98a9-e91fd8b2ff9d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-c1c6f4fa-0842-4f3b-98a9-e91fd8b2ff9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:43.851392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:43.852911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:43.854461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:43.854461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:43.854461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:43.854461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:43.854461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 307/622] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:43.854757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f000-a4d5-4c6a-b474-36c3c1f74400 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.854976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f000-a4d5-4c6a-b474-36c3c1f74400 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.855223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f000-a4d5-4c6a-b474-36c3c1f74400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.872471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ea31f000-a4d5-4c6a-b474-36c3c1f74400 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:43.873659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ea31f000-a4d5-4c6a-b474-36c3c1f74400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:43.898799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.906464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.939754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47f131-95b0-4a82-b6e6-a197a3fefd52 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.945877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 308/623] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:43.946816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f000-a4d5-4c6a-b474-36c3c1f74400 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.987723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.988410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.988769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.989120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.990411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:43.990813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.992605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.007998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 316/624] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:44.008872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.072077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f000-a4d5-4c6a-b474-36c3c1f74400 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.113832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.114532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.114980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.115260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.116584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:44.116901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.118910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.119162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55d964-1b88-44af-8860-b15a71154b4b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.133961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 309/625] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:44.135374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.159888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.166205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.169681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460c2f3-b895-4d0e-8f74-da8d6ac8fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.174188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c2f3-b895-4d0e-8f74-da8d6ac8fe5b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.174188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c2f3-b895-4d0e-8f74-da8d6ac8fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.174188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c2f3-b895-4d0e-8f74-da8d6ac8fe5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.187924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460c2f3-b895-4d0e-8f74-da8d6ac8fe5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-9460c2f3-b895-4d0e-8f74-da8d6ac8fe5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:44.198940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:44.200113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:44.201183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:44.206818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 317/626] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:44.206818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460c2f3-b895-4d0e-8f74-da8d6ac8fe5b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.254825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3ee33-a27c-4c74-8dff-a4a5c91791ab None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.292614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.293885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.294413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.294893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.302494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.304261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.312078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460c2f3-b895-4d0e-8f74-da8d6ac8fe5b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:44.319932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:44.320853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:44.321780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:44.321780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:44.321780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:44.321780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:44.321780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:44.321780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:44.321780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:44.321780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:44.324297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 310/627] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:44.325306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.353706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.354638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.354936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.355194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.362856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.364308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:44.379269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:44.380257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:33:44.381232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:44.385071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 318/628] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:44.385972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.426481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.438555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.442803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7796a-2ba8-4574-b9c5-730d621c27bb None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.478526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.479625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.480109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.480585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.481520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:44.482394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.483972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.492455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed5486-349d-44a9-94ee-9727804fc81e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.498016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 311/629] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:44.499405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.531578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.532056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.532344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.532626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.533412 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:44.533728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.535474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.553802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 319/630] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:44.554949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.613844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f242e-5574-4b98-b55e-1d52c1f605e8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.651096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.652132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.652614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.653101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.654142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:44.654674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.656479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.664677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4da5aa-71cc-4642-9149-1842251600db None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.671790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.676648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 312/631] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:44.677006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.678210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.708558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.709356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.709698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.709983 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.722492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.724006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:44.747627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:44.748587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:44.748587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:44.748587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:44.748587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:44.752941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 320/632] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:44.753870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.814371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be6fad-b7d3-4d7a-ba65-db2a28fec7e7 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.854296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7addc22-2f70-4fa0-8cc3-71bea1e97b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.855571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7addc22-2f70-4fa0-8cc3-71bea1e97b3b None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.856114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7addc22-2f70-4fa0-8cc3-71bea1e97b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.856703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7addc22-2f70-4fa0-8cc3-71bea1e97b3b None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/0c3a489751424d008dbfefa89d19883a/roles/af9f77c3be4c47969788085eedea854d` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.862713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c67b1-b2e7-4464-acd4-98fd6d890458 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.873968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7addc22-2f70-4fa0-8cc3-71bea1e97b3b None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=0c3a489751424d008dbfefa89d19883a, role_id=af9f77c3be4c47969788085eedea854d)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.875760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7addc22-2f70-4fa0-8cc3-71bea1e97b3b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.899541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc021fb7-d927-48b7-86c5-00d3b16b5a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.900202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc021fb7-d927-48b7-86c5-00d3b16b5a69 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.900486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc021fb7-d927-48b7-86c5-00d3b16b5a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.900762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc021fb7-d927-48b7-86c5-00d3b16b5a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.932431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.970749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc021fb7-d927-48b7-86c5-00d3b16b5a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.972253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc021fb7-d927-48b7-86c5-00d3b16b5a69 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:45.087897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 321/633] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:45.087897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc021fb7-d927-48b7-86c5-00d3b16b5a69 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:45.112640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 313/634] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:44 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/0c3a489751424d008dbfefa89d19883a/roles/af9f77c3be4c47969788085eedea854d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:45.117645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7addc22-2f70-4fa0-8cc3-71bea1e97b3b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:45.161330 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:45.207707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:45.222980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc021fb7-d927-48b7-86c5-00d3b16b5a69 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:45.277755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e78e6-0487-4402-82c7-788d8cb0acbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:45.278428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7addc22-2f70-4fa0-8cc3-71bea1e97b3b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:45.278554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e78e6-0487-4402-82c7-788d8cb0acbe None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.278960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e78e6-0487-4402-82c7-788d8cb0acbe None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.279247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e78e6-0487-4402-82c7-788d8cb0acbe None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.279984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e78e6-0487-4402-82c7-788d8cb0acbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:45.280311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e78e6-0487-4402-82c7-788d8cb0acbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:45.281716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e78e6-0487-4402-82c7-788d8cb0acbe None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:45.295307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 322/635] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:45.297568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84524a1-2c8f-4165-b10c-80fdc33114d4 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.297697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84524a1-2c8f-4165-b10c-80fdc33114d4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.297897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84524a1-2c8f-4165-b10c-80fdc33114d4 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.299643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 323/636] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:45.303141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84524a1-2c8f-4165-b10c-80fdc33114d4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:45.328409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba467996-7754-4c94-9a50-ef74af523392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:45.329217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba467996-7754-4c94-9a50-ef74af523392 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.329505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba467996-7754-4c94-9a50-ef74af523392 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.329783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba467996-7754-4c94-9a50-ef74af523392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.342469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba467996-7754-4c94-9a50-ef74af523392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:45.343968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba467996-7754-4c94-9a50-ef74af523392 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ba467996-7754-4c94-9a50-ef74af523392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:45.362623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:45.363610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:45.365180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:45.365180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:45.365180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:45.365180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:45.365180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 314/637] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:45.365180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277066f4-9b4c-4a11-9171-5201a318b1d3 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.365564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277066f4-9b4c-4a11-9171-5201a318b1d3 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.365564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277066f4-9b4c-4a11-9171-5201a318b1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.384696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-277066f4-9b4c-4a11-9171-5201a318b1d3 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:45.385937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-277066f4-9b4c-4a11-9171-5201a318b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:45.448396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84524a1-2c8f-4165-b10c-80fdc33114d4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:45.462576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 315/638] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:45.463474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277066f4-9b4c-4a11-9171-5201a318b1d3 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:45.486512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:45.499893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:45.500760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.501053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.501334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.508853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:45.512541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:45.514717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:45.531091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:45.532170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 324/639] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:45.538076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:45.589371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277066f4-9b4c-4a11-9171-5201a318b1d3 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:45.627392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856b039-8f95-43d4-82a1-a52900fb0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:45.628456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b039-8f95-43d4-82a1-a52900fb0f7e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.628936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b039-8f95-43d4-82a1-a52900fb0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.629399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b039-8f95-43d4-82a1-a52900fb0f7e None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.630440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856b039-8f95-43d4-82a1-a52900fb0f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:45.630987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856b039-8f95-43d4-82a1-a52900fb0f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:45.632651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856b039-8f95-43d4-82a1-a52900fb0f7e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:45.650161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 316/640] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:45.650161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ba65c-0230-4bbb-9246-c458d1b48fdb None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.650161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ba65c-0230-4bbb-9246-c458d1b48fdb None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.650161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ba65c-0230-4bbb-9246-c458d1b48fdb None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.654211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 317/641] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:45.654211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ba65c-0230-4bbb-9246-c458d1b48fdb None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:45.657796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881d5a-966a-4805-ae75-6df6ef4e996e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:45.697550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21582e2-85a5-42ff-b4ac-c36141822cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:45.698383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21582e2-85a5-42ff-b4ac-c36141822cda None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.698671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21582e2-85a5-42ff-b4ac-c36141822cda None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.698950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21582e2-85a5-42ff-b4ac-c36141822cda None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.709779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21582e2-85a5-42ff-b4ac-c36141822cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-c21582e2-85a5-42ff-b4ac-c36141822cda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:45.717591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:45.718686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 325/642] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:45.719596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21582e2-85a5-42ff-b4ac-c36141822cda None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:45.762297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:45.772552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ba65c-0230-4bbb-9246-c458d1b48fdb None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:45.786320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:45.806754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc0af7-f98d-49eb-ae77-9ffca309dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:45.807438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc0af7-f98d-49eb-ae77-9ffca309dbac None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.807888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc0af7-f98d-49eb-ae77-9ffca309dbac None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.808057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc0af7-f98d-49eb-ae77-9ffca309dbac None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.809069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc0af7-f98d-49eb-ae77-9ffca309dbac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:45.809747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc0af7-f98d-49eb-ae77-9ffca309dbac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:45.812241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc0af7-f98d-49eb-ae77-9ffca309dbac None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:45.832864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 318/643] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:45.835695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3374-d242-46a4-905c-1761cb30a226 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.836167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3374-d242-46a4-905c-1761cb30a226 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.836627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3374-d242-46a4-905c-1761cb30a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.846891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21582e2-85a5-42ff-b4ac-c36141822cda None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:45.856952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9afa3374-d242-46a4-905c-1761cb30a226 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:45.858784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9afa3374-d242-46a4-905c-1761cb30a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:45.883256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:45.884987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:45.885273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:45.885548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:45.893072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:45.894851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:45.910190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:45.911160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 326/644] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:45.912940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:45.946471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 319/645] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:45.946471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa3374-d242-46a4-905c-1761cb30a226 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.024105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.038113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbfb9e-0eaf-4226-95fb-b394a4ee26bb None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.039876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.043655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa3374-d242-46a4-905c-1761cb30a226 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.075547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.076216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.076503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.076783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.077533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:46.077844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:46.079247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:46.080346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9108ca-e03b-406d-bab0-5d8e35c2be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.081165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9108ca-e03b-406d-bab0-5d8e35c2be0c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.081771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9108ca-e03b-406d-bab0-5d8e35c2be0c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.082328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9108ca-e03b-406d-bab0-5d8e35c2be0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.089634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 327/646] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:46.090837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.159185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9108ca-e03b-406d-bab0-5d8e35c2be0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:46.160557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9108ca-e03b-406d-bab0-5d8e35c2be0c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:46.200552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc35f07-d350-4f8f-adaa-5253722d83e4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.234285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.234947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.235236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.235557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.236308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:46.236717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:46.238171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:46.248494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.251596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 328/647] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:46.256971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.269571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 320/648] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:46.270729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9108ca-e03b-406d-bab0-5d8e35c2be0c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.283790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.363971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf37d8-4821-4fda-9fcb-b284bf63221f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.384716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9108ca-e03b-406d-bab0-5d8e35c2be0c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.400924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a1e1-a7db-46de-a8db-697391137c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.401726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a1e1-a7db-46de-a8db-697391137c70 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.402015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a1e1-a7db-46de-a8db-697391137c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.402323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a1e1-a7db-46de-a8db-697391137c70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126a1e1-a7db-46de-a8db-697391137c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-8126a1e1-a7db-46de-a8db-697391137c70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:46.422901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:46.423831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:46.424594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.424594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.424594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.424594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.427944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 329/649] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:46.428597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a1e1-a7db-46de-a8db-697391137c70 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.437375 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:46.438992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:46.457792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:46.458783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:46.459748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:46.459748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:46.459748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:46.459748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:46.464231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 321/650] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:46.464933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.497937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.526466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.543906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a1e1-a7db-46de-a8db-697391137c70 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.569210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a21d-cb24-4765-b40c-42e907ef7832 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.580991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.581661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.581942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.582247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.583200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=d42bb727957e40dca943c47785819223) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:46.583627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:46.585036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:46.602129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 330/651] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/role_assignments?user.id=d42bb727957e40dca943c47785819223&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:46.602129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.616732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.617753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.618132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.618512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.631333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:46.633131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:46.654675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:46.655705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:46.656622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:46.656622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:46.656622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:46.656622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:46.660718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 322/652] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:46.661702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.723980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae87a8-266e-4128-8df2-01d4932bbc6e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.765654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.785310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a67e1-a17b-46bf-8de2-52dd9160c69c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.787074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.789503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.790894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.791580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.792984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:46.794324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:46.797331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:46.816652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 331/653] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:46.818141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.839879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.841304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:46.842087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.842604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.843013 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.844029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:46.844412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:46.846265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:46.860622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 323/654] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:46.861478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.963727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68649419-06f9-45ef-b140-bdc2eed5cf6f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:46.987923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c86196-bb59-48d0-80eb-b2f8f1871f5b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.005913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.007021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.007312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.007587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.009009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:47.009424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.011021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.031715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 332/655] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:47.031715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.038226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.039949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.040444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.040943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.056490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.059302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.087057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:47.091955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:47.092874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:47.093790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:47.093790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:47.093790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:47.093790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:47.096346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 324/656] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:47.098172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.113073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.147953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47fb7a-a8b0-4854-81bc-0234115dc485 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.185634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.186760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.187215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.187638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.195863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.198066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.212968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4fec-77d4-4c1f-b934-41e7c00842de None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:47.213672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:47.214848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:33:47.215948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:47.222755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 333/657] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:47.223956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.256800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.257555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.257839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.258143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.266709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.268154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:47.285452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:47.286486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 325/658] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:47.287429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.339839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f12580-2a4c-4088-9be1-94776af30250 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.349678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.371289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.379280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cabe0-da60-431e-b4d0-e967be988691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.379955 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cabe0-da60-431e-b4d0-e967be988691 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.380245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cabe0-da60-431e-b4d0-e967be988691 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.380551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cabe0-da60-431e-b4d0-e967be988691 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.381256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cabe0-da60-431e-b4d0-e967be988691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:47.381652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cabe0-da60-431e-b4d0-e967be988691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.383053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cabe0-da60-431e-b4d0-e967be988691 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.396023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b314c8-dc79-4e5d-aa1c-1c6f4526dc55 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.407094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 334/659] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:47.408506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b78c-af62-4620-af17-3d7a2472a2ec None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.408871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b78c-af62-4620-af17-3d7a2472a2ec None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.409221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b78c-af62-4620-af17-3d7a2472a2ec None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.410702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 335/660] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:47.415353 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43b78c-af62-4620-af17-3d7a2472a2ec None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.445609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.447487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.447906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.448182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.449030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:47.449343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.450799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.473986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 326/661] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:47.474927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.525119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43b78c-af62-4620-af17-3d7a2472a2ec None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.561098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd51e5-6ef2-4aa8-9417-8e998d742948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.561762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd51e5-6ef2-4aa8-9417-8e998d742948 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.562053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd51e5-6ef2-4aa8-9417-8e998d742948 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.562376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd51e5-6ef2-4aa8-9417-8e998d742948 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.563171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd51e5-6ef2-4aa8-9417-8e998d742948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:47.563485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd51e5-6ef2-4aa8-9417-8e998d742948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.564914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd51e5-6ef2-4aa8-9417-8e998d742948 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.583183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 336/662] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:47.583183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ce71-c12b-4aa1-ad45-0974f76ecee4 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.583183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ce71-c12b-4aa1-ad45-0974f76ecee4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.583183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ce71-c12b-4aa1-ad45-0974f76ecee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.595434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62504765-b792-49fa-9a5c-e4a4cdc0de95 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.596928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1637ce71-c12b-4aa1-ad45-0974f76ecee4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:47.598127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1637ce71-c12b-4aa1-ad45-0974f76ecee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:47.611329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.631843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.632643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.638452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.638452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.640632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.642237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.649710 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:47.659266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:47.660354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:47.661429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 327/663] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:47.662056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.678143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 337/664] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:47.678143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ce71-c12b-4aa1-ad45-0974f76ecee4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.781137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b7916-26ed-4e07-935f-34279cb04ba1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.802398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ce71-c12b-4aa1-ad45-0974f76ecee4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.819031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b7021-0fc6-4f99-bd20-e0c2fc4b8b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.820036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7021-0fc6-4f99-bd20-e0c2fc4b8b2e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.820527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7021-0fc6-4f99-bd20-e0c2fc4b8b2e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.820921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7021-0fc6-4f99-bd20-e0c2fc4b8b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.842710 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.843804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.844093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.844526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.845367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=035eeee0a72449358827a34bb09aa057) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:47.845688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.847195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.853799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 338/665] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/role_assignments?user.id=035eeee0a72449358827a34bb09aa057&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:47.854643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.872684 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.900239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b7021-0fc6-4f99-bd20-e0c2fc4b8b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.902005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b7021-0fc6-4f99-bd20-e0c2fc4b8b2e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.924389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.002044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe56c9-58db-466f-83d9-3bc3ad8a2874 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.025111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 328/666] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:48.025969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b7021-0fc6-4f99-bd20-e0c2fc4b8b2e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.050268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.050857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.051140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.051421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.052267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:48.052814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.053989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.076794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 339/667] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:48.077463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.113030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.151811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b7021-0fc6-4f99-bd20-e0c2fc4b8b2e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.192714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493758-ef5b-4d38-9fe4-b4cceee671a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.193778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493758-ef5b-4d38-9fe4-b4cceee671a1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.194068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493758-ef5b-4d38-9fe4-b4cceee671a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.194835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493758-ef5b-4d38-9fe4-b4cceee671a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.202190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a6642-a901-4eeb-afaa-8352b23880f4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.205054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.208796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493758-ef5b-4d38-9fe4-b4cceee671a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-f0493758-ef5b-4d38-9fe4-b4cceee671a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:48.219063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:48.220058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:48.221164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 329/668] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:48.222042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493758-ef5b-4d38-9fe4-b4cceee671a1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.256631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.258025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.258511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.259089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.273605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.275855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:48.299551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:48.300731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:48.301845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:48.301845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:48.301845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:48.301845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:48.304366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 340/669] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:48.305536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.346901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493758-ef5b-4d38-9fe4-b4cceee671a1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.382485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeeeb9-1c14-4275-804a-6d6750da63c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.383970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeeeb9-1c14-4275-804a-6d6750da63c1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.384437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeeeb9-1c14-4275-804a-6d6750da63c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.384916 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeeeb9-1c14-4275-804a-6d6750da63c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.387868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.427335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae0ee4-e5a2-45fc-a70a-1670060a3f5a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.457229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eeeeb9-1c14-4275-804a-6d6750da63c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.459041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eeeeb9-1c14-4275-804a-6d6750da63c1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.466378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.467066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.467356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.467640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.468408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:48.468721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.470235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.481107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 341/670] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:48.481986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.507116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.567814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 330/671] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:48.568985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeeeb9-1c14-4275-804a-6d6750da63c1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.605579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.610985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcb5ff-94b3-4245-8759-c38d37abb5a5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.650673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.651377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.652016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.652153 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.652853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:48.653170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.655084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.673384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 342/672] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:48.674769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.676988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeeeb9-1c14-4275-804a-6d6750da63c1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.713486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.714648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.715133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.715605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.726782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.728521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:48.753114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:48.754142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:48.755071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:48.755071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:48.755071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:48.755071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:48.757326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 331/673] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:48.758920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.768356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.795554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e9740-f30b-4e5c-bb34-e56e2191b920 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.834942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.835978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.836444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.836865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.848496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.850182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.855026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.870478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2225ac-b511-4d85-9688-94329e2e0ef5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:48.871966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:48.872858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:48.873763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:48.873763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:48.873763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:48.873763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:48.873763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 343/674] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:48.874054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.911209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09874769-e504-4382-a482-47960173452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:48.912003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874769-e504-4382-a482-47960173452d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.912287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874769-e504-4382-a482-47960173452d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.912565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874769-e504-4382-a482-47960173452d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.919439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09874769-e504-4382-a482-47960173452d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.920883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09874769-e504-4382-a482-47960173452d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-09874769-e504-4382-a482-47960173452d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:48.935060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:48.936011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:48.936978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 332/675] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:48.937483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4a27-0fe3-4164-bb19-8234a13cd611 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:48.938033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4a27-0fe3-4164-bb19-8234a13cd611 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:48.938033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4a27-0fe3-4164-bb19-8234a13cd611 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:48.942221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 333/676] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:48.942221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a4a27-0fe3-4164-bb19-8234a13cd611 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:48.986633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da48b0-1c8b-4942-bf9b-5900856b9289 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.015458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.023806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.024561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.024883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.025158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.025883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:49.026230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.027583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.038947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 344/677] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:49.039758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.059448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a4a27-0fe3-4164-bb19-8234a13cd611 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.097965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb68402-b6e7-4e0c-903d-1ce47fda6514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.098816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68402-b6e7-4e0c-903d-1ce47fda6514 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.098917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68402-b6e7-4e0c-903d-1ce47fda6514 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.099486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68402-b6e7-4e0c-903d-1ce47fda6514 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.099818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb68402-b6e7-4e0c-903d-1ce47fda6514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:49.100127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb68402-b6e7-4e0c-903d-1ce47fda6514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.101504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb68402-b6e7-4e0c-903d-1ce47fda6514 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.114428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 334/678] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:49.115754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126a446-1953-4653-bf6d-94e7d9105549 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.116048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126a446-1953-4653-bf6d-94e7d9105549 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.116326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126a446-1953-4653-bf6d-94e7d9105549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.127919 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.134137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0126a446-1953-4653-bf6d-94e7d9105549 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:49.135562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0126a446-1953-4653-bf6d-94e7d9105549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:49.154317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dd1d-1359-46d2-8cdb-738cf1dc6d2f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.196915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.197575 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.197868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.198188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.198984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:49.199300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.200777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.210137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 335/679] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:49.210959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126a446-1953-4653-bf6d-94e7d9105549 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.223087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 345/680] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:49.224820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.279206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.321206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126a446-1953-4653-bf6d-94e7d9105549 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.335008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c9268-efea-4511-9fcd-8e7bac54225a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.364635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.365340 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.365626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.365901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] PATH_INFO: `/v3/users/swift` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.369339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.376935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.384730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.384730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.384730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.384983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.385067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.386407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.387836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:49.401131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:49.402431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:33:49.403386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:49.403962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:49.405573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:49.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:49.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:49.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:49.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:49.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:49.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:49.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:49.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:49.416463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 336/681] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:49.416463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.416676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 346/682] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:49.416676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.524723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce06ec5-e1ce-434e-8858-5428402d0fd2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.524925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08a7bf-1042-4e9b-814e-18b4c2b1845f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.535568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.562199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.562855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.563141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.563417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.564248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=96a80e224da849e19538182793f13e10) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:49.564563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.565485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.566055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.566773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.567262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.567744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.572215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 337/683] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/role_assignments?user.id=96a80e224da849e19538182793f13e10&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:49.572997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.587709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.589336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:49.609486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:49.610718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:49.611686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:49.611686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:49.611686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:49.611686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:49.616254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 347/684] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:49.617221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.656158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.711222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b16ba-aee2-431f-ad9e-adf2da4f2b63 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.739161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcbe57-dd4e-485b-8c1a-eb3eb6542a5b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.752860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.753833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.754336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.754777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.755888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:49.756366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.758320 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.780578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 338/685] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:49.781419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.792266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.792936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.793226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.793506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.794359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:49.794677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.796140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.809336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 348/686] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:49.809992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.835016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.911974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf212b-111e-4a98-ba47-d23fbf4fe023 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.930496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.948816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.949489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.952155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.952155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.952155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:49.952419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643acda7-dcec-4a44-94c3-de2bec4c7b6a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.952499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.952836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.970216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 339/687] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:49.971177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.996162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0636034-cf37-4b10-8093-f8b3c2286dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.996824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636034-cf37-4b10-8093-f8b3c2286dad None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.997112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636034-cf37-4b10-8093-f8b3c2286dad None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.997442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636034-cf37-4b10-8093-f8b3c2286dad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.087707 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636034-cf37-4b10-8093-f8b3c2286dad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:50.089857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636034-cf37-4b10-8093-f8b3c2286dad None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:50.093595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783b164-12a7-46eb-b273-297b6b1f094f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:50.114276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:50.129570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:50.130500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.130500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.130789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.131691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=092f588c7472454c8a6f435525e40a2c) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:50.131999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:50.133965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:50.140502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 340/688] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/role_assignments?user.id=092f588c7472454c8a6f435525e40a2c&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:50.141098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:50.195679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:50.213721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 349/689] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:50.215352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c429-4996-4bbc-9d37-207df3620e24 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.215667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c429-4996-4bbc-9d37-207df3620e24 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.215915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c429-4996-4bbc-9d37-207df3620e24 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.221267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 350/690] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:50.222475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5c429-4996-4bbc-9d37-207df3620e24 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:50.267271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811c1ea-fc92-4ea8-9b89-3fa08e3d0533 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:50.305853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27acd86-465b-4d60-a24e-9ff2a0425d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:50.306824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27acd86-465b-4d60-a24e-9ff2a0425d2d None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.307250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27acd86-465b-4d60-a24e-9ff2a0425d2d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.307689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27acd86-465b-4d60-a24e-9ff2a0425d2d None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.308534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27acd86-465b-4d60-a24e-9ff2a0425d2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:50.310130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27acd86-465b-4d60-a24e-9ff2a0425d2d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:50.337466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5c429-4996-4bbc-9d37-207df3620e24 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:50.359622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:50.376890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:50.377771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.378153 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.378501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.390684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:50.392200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:50.405304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 341/691] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:33:50 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:50.407133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463f52-dffe-4595-a5d3-dda9e73de142 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.407672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463f52-dffe-4595-a5d3-dda9e73de142 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.408208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463f52-dffe-4595-a5d3-dda9e73de142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:50.412332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:50.413352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:50.414351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:50.414351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:50.414351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:50.414351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:50.414351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 351/692] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:50.419868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:50.439933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-65463f52-dffe-4595-a5d3-dda9e73de142 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:50.441731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-65463f52-dffe-4595-a5d3-dda9e73de142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:50.542965 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01dc4c-ceb9-4c27-a28c-edcc8fa3fb27 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:50.550156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 342/693] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:50.590206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:50.591339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.591830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.593330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65463f52-dffe-4595-a5d3-dda9e73de142 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:50.596004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.603528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:50.606875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:50.608678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:50.633789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 352/694] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:50.638492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:50.639606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:50.684445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:50.726071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65463f52-dffe-4595-a5d3-dda9e73de142 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:50.775050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39128d-95c1-42cf-8a4c-bcc6ca64d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:50.776718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39128d-95c1-42cf-8a4c-bcc6ca64d97f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.777898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39128d-95c1-42cf-8a4c-bcc6ca64d97f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.778435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39128d-95c1-42cf-8a4c-bcc6ca64d97f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.786598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8cfeb-458f-47b5-a309-fa2c42e1f483 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:50.793894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39128d-95c1-42cf-8a4c-bcc6ca64d97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ca39128d-95c1-42cf-8a4c-bcc6ca64d97f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:50.804109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:50.805942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:50.807062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:50.809294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 343/695] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:50.814698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39128d-95c1-42cf-8a4c-bcc6ca64d97f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:50.833392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:50.834541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.834992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.835441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.844587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:50.846440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:50.863761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:50.864791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:50.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:50.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:50.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:50.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:50.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:50.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:50.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:50.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:50.869327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 353/696] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:50.874081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:50.931677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:50.947550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39128d-95c1-42cf-8a4c-bcc6ca64d97f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:51.016387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:51.017466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.017954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.018666 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.022372 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:51.022902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:51.025024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:51.031545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:51.044608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 344/697] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:51.044781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86122f03-1a93-4b3c-899c-7b3549bed15c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:51.049448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:51.105284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:51.106550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.107665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.108326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.110679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:51.112086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:51.114436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:51.137680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 354/698] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:51.144398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:51.256918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83188d53-4311-4ed0-a562-7c388db13bb0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:51.309050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293908d7-8c62-43d7-96ae-037a68850377 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:51.332463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:51.333328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.333621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.333900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.347638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:51.348770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.349082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.349368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.350256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=0c3a489751424d008dbfefa89d19883a) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:51.350583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:51.352037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:51.359500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 355/699] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:51 2022] GET /identity/v3/role_assignments?user.id=0c3a489751424d008dbfefa89d19883a&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:51.360224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:51.361687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:51.402877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:51.403868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:51.404789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:51.404789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:51.404789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:51.404789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:51.410563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 345/700] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:51.417106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:51.451239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:51.570069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4f50-6340-48f0-b2b9-007e095e0f4c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:51.619057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:51.619735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.620027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.620313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.621055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:51.621369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:51.622775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:51.636640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 356/701] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:51.641905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:51.648618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:51.764084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353d6b4-33a0-42b5-b882-c4d7f4943fa0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:51.798131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcf485-6d9c-45f8-87c7-f3766d2d13ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:51.798937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf485-6d9c-45f8-87c7-f3766d2d13ce None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.799217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf485-6d9c-45f8-87c7-f3766d2d13ce None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.799492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf485-6d9c-45f8-87c7-f3766d2d13ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.807917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcf485-6d9c-45f8-87c7-f3766d2d13ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:51.809370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcf485-6d9c-45f8-87c7-f3766d2d13ce None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-9dbcf485-6d9c-45f8-87c7-f3766d2d13ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:51.824268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:51.825238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:51.826275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 346/702] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:33:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:51.831353 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:51.925260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:51.950819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a52b9-c40a-4950-878d-52102e20442c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:51.971484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286253bf-6348-4d42-9fdf-8be5180591d5 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.972026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286253bf-6348-4d42-9fdf-8be5180591d5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.972026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286253bf-6348-4d42-9fdf-8be5180591d5 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.974920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 347/703] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:51.979716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d2f5-fe19-4c45-9786-7fd060666186 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.980001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d2f5-fe19-4c45-9786-7fd060666186 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.980280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d2f5-fe19-4c45-9786-7fd060666186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.996167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:51.997201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.997719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.998245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.998352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1610d2f5-fe19-4c45-9786-7fd060666186 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:51.999485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:51.999595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1610d2f5-fe19-4c45-9786-7fd060666186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:52.000122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.001989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.034690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 357/704] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:33:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:52.040033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.063245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.076272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 348/705] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:52.096984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d2f5-fe19-4c45-9786-7fd060666186 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.203995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d2f5-fe19-4c45-9786-7fd060666186 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.214328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1b09-c4cf-437f-beac-a8848d314e39 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.242285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.243692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.243981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.244260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.244927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.246355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:52.274590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:52.275644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:33:52.276521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:52.286066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 349/706] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:52.288203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f385-e502-479d-aff1-df8359e19e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.288877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f385-e502-479d-aff1-df8359e19e2f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.289166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f385-e502-479d-aff1-df8359e19e2f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.289987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f385-e502-479d-aff1-df8359e19e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.291567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.296915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.362956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.408546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd6d50-ce2f-41a2-ac6f-820eea1f8ebe None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.444480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.445318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.445735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.446128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.446963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:52.450819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.450819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.458256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 350/707] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:52.460307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.466939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1f385-e502-479d-aff1-df8359e19e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.468400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1f385-e502-479d-aff1-df8359e19e2f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.593133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef5ec6-c7ab-4ffb-acf6-27dc895b04a3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.619796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 358/708] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:52.626999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f385-e502-479d-aff1-df8359e19e2f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.630174 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.660433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324e3a4-4ffd-4df8-a05b-e0d3b7a1515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.661486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324e3a4-4ffd-4df8-a05b-e0d3b7a1515d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.662796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324e3a4-4ffd-4df8-a05b-e0d3b7a1515d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.666161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324e3a4-4ffd-4df8-a05b-e0d3b7a1515d None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.667156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324e3a4-4ffd-4df8-a05b-e0d3b7a1515d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:52.667673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324e3a4-4ffd-4df8-a05b-e0d3b7a1515d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.669283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324e3a4-4ffd-4df8-a05b-e0d3b7a1515d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.686133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 351/709] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:52.686133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b545-91d9-497d-809d-a5343d16b1fa None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.686133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b545-91d9-497d-809d-a5343d16b1fa None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.686133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b545-91d9-497d-809d-a5343d16b1fa None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.686700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 352/710] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:52.694132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.694332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b994-bf90-4563-bd2d-892799dfd898 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.694332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b994-bf90-4563-bd2d-892799dfd898 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.694332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b994-bf90-4563-bd2d-892799dfd898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.711215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-2589b994-bf90-4563-bd2d-892799dfd898 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:52.712473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2589b994-bf90-4563-bd2d-892799dfd898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:52.842169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f385-e502-479d-aff1-df8359e19e2f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.854834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 353/711] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:52.896743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.897903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.898450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.899394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.900413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b994-bf90-4563-bd2d-892799dfd898 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.916137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.918814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:52.940721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:52.941745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:52.943100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:52.943100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:52.943100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:52.943100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:52.943100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 359/712] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:52.948003 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:53.020615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b994-bf90-4563-bd2d-892799dfd898 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.040241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.058621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.059730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.060234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.060659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.061554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.063783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:53.077165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:53.078560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:53.087358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 354/713] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:53.089524 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:53.112309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.123892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc6195-27d2-46ab-b45f-6e4af7387505 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.163171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf8cb1-7304-4110-b91a-842f737824f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.163961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf8cb1-7304-4110-b91a-842f737824f6 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.164349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf8cb1-7304-4110-b91a-842f737824f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.165309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf8cb1-7304-4110-b91a-842f737824f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.166119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf8cb1-7304-4110-b91a-842f737824f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:53.166552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf8cb1-7304-4110-b91a-842f737824f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.168360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf8cb1-7304-4110-b91a-842f737824f6 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.181956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 360/714] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:53.183613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c537a08-257e-458a-8aad-a02efa8d81e2 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.183988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c537a08-257e-458a-8aad-a02efa8d81e2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.184369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c537a08-257e-458a-8aad-a02efa8d81e2 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.186271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 361/715] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:53.187722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c537a08-257e-458a-8aad-a02efa8d81e2 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:53.220552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24089-175e-4dc1-b337-775f67eef9e1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.259331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17ecca-586e-4ac8-b762-de26be24f103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.260541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17ecca-586e-4ac8-b762-de26be24f103 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.261028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17ecca-586e-4ac8-b762-de26be24f103 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.262146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17ecca-586e-4ac8-b762-de26be24f103 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.263072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17ecca-586e-4ac8-b762-de26be24f103 None admin] RBAC: Adding query filter params (name=network) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:53.264090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17ecca-586e-4ac8-b762-de26be24f103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.266855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17ecca-586e-4ac8-b762-de26be24f103 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.276435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 355/716] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:33:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:53.278754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50585a5-0d5a-468f-bcb6-486ecbc03fe1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.279343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50585a5-0d5a-468f-bcb6-486ecbc03fe1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.279826 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50585a5-0d5a-468f-bcb6-486ecbc03fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.307323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d50585a5-0d5a-468f-bcb6-486ecbc03fe1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:53.309070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d50585a5-0d5a-468f-bcb6-486ecbc03fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:53.309253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c537a08-257e-458a-8aad-a02efa8d81e2 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.347999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.348799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.349088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.349374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.357819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.358374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.359772 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:53.375512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:53.376930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:53.377871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 362/717] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:53.378402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:53.387859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.401540 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 356/718] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:53.403025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50585a5-0d5a-468f-bcb6-486ecbc03fe1 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:53.509107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501a176-05fc-425d-b886-f28bbf8b48d5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.525470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50585a5-0d5a-468f-bcb6-486ecbc03fe1 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.553264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.554376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.554871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.555355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.556352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] RBAC: Adding query filter params (type=network) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:53.557089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.558669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.561940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.562923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.563034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.563229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.564037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:53.564347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.565800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.567263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 363/719] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:33:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:53.568448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:53.594748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 357/720] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:53.600494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:53.653482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.679435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.690520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ca0d-e5dc-47f7-a10d-8d06dec324c5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.729642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260306-97e2-4917-8813-8b789cfccdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.730799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260306-97e2-4917-8813-8b789cfccdd9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.731326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260306-97e2-4917-8813-8b789cfccdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.731779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260306-97e2-4917-8813-8b789cfccdd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.763470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260306-97e2-4917-8813-8b789cfccdd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-7e260306-97e2-4917-8813-8b789cfccdd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:53.782169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:53.783217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:53.784081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 364/721] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:53.787012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260306-97e2-4917-8813-8b789cfccdd9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:53.830896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1efc6-b6f4-4c3f-b224-d13eb6d91eab None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.888363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.889367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.889694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.890306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.891298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=035eeee0a72449358827a34bb09aa057) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:53.891621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.893206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.904490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 358/722] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:53 2022] GET /identity/v3/role_assignments?user.id=035eeee0a72449358827a34bb09aa057&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:53.928843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260306-97e2-4917-8813-8b789cfccdd9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.962761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.969772 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.970576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.970866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.971150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.971926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:53.972251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.973659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.983842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 365/723] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:53.991330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:54.133042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:54.142376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c1b2c-c701-48c3-add1-e263bbe0976c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:54.193328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28def93a-2212-479b-a521-4c92a7b515fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:54.194228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def93a-2212-479b-a521-4c92a7b515fc None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.194518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def93a-2212-479b-a521-4c92a7b515fc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.194797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def93a-2212-479b-a521-4c92a7b515fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.207946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28def93a-2212-479b-a521-4c92a7b515fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:54.209491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28def93a-2212-479b-a521-4c92a7b515fc None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-28def93a-2212-479b-a521-4c92a7b515fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:54.234752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:54.236920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:54.239192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:54.239192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:54.239192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:54.239192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:54.239192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 359/724] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:54.241760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:54.320517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f46ed-7e71-4f0f-b6aa-9dfdbfa1cc78 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.321373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f46ed-7e71-4f0f-b6aa-9dfdbfa1cc78 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.321664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f46ed-7e71-4f0f-b6aa-9dfdbfa1cc78 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.323899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 360/725] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:54.329319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb57569-7362-4388-abda-40b8106c7b9f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.329914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb57569-7362-4388-abda-40b8106c7b9f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.330430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb57569-7362-4388-abda-40b8106c7b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.347803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1eb57569-7362-4388-abda-40b8106c7b9f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:54.349321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1eb57569-7362-4388-abda-40b8106c7b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:54.377416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7874cd-6a53-41dc-b8c9-dd74688b3c72 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:54.417808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:54.418394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.418679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.418961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.420025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:54.420347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:54.421723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:54.448858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 366/726] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:54.454997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:54.489387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 361/727] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:33:54.542985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:54.546642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb57569-7362-4388-abda-40b8106c7b9f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:54.594823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c13e7-c13e-4353-a06e-c936ffc40389 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:54.632961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:54.634334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.634627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.634906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.650961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:54.653314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:54.671217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:54.672240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:54.673840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 367/728] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:33:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:54.679732 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:54.713289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:54.761896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb57569-7362-4388-abda-40b8106c7b9f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:54.832112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529dfee-35ef-499a-8f93-8b52daf85ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:54.832930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529dfee-35ef-499a-8f93-8b52daf85ec7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.833225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529dfee-35ef-499a-8f93-8b52daf85ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.833486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529dfee-35ef-499a-8f93-8b52daf85ec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.858707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529dfee-35ef-499a-8f93-8b52daf85ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-b529dfee-35ef-499a-8f93-8b52daf85ec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:54.869273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:54.870271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:54.871754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 362/729] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:54.876212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529dfee-35ef-499a-8f93-8b52daf85ec7 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:54.893059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ce4c9-61d2-4f61-b771-e8c8e750b84a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:54.913719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:54.956535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:54.957129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.957413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.957691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.958568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:54.958881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:54.960313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:54.988040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 368/730] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Jul 11 14:33:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:54.993852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.072087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529dfee-35ef-499a-8f93-8b52daf85ec7 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.113683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.114408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.114688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.114970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.115720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:55.116031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.117510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.123700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.128193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 363/731] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:55.133771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.145519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb724ef7-0018-4688-94a5-26caa6593560 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.193716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603219d-2fef-4a72-ad79-166addd4bfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.194823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603219d-2fef-4a72-ad79-166addd4bfd3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.195113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603219d-2fef-4a72-ad79-166addd4bfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.195393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603219d-2fef-4a72-ad79-166addd4bfd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.250831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.278326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ce4ac-5d87-4c70-9051-70fdc215ce77 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.286090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603219d-2fef-4a72-ad79-166addd4bfd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.287573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603219d-2fef-4a72-ad79-166addd4bfd3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.342180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815b4e8-e413-436a-a30d-0eb4e7a7720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.343923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b4e8-e413-436a-a30d-0eb4e7a7720c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.343923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b4e8-e413-436a-a30d-0eb4e7a7720c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.344231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b4e8-e413-436a-a30d-0eb4e7a7720c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.356601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815b4e8-e413-436a-a30d-0eb4e7a7720c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.358345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815b4e8-e413-436a-a30d-0eb4e7a7720c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-7815b4e8-e413-436a-a30d-0eb4e7a7720c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:55.381823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:55.383887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:55.385903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:55.385903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:55.385903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:55.385903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:55.388585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 364/732] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:55.390478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8176a-3dc6-4969-83e2-775fddcd03e9 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.390805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8176a-3dc6-4969-83e2-775fddcd03e9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.391064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8176a-3dc6-4969-83e2-775fddcd03e9 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.392818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 365/733] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:55.393747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8176a-3dc6-4969-83e2-775fddcd03e9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.429964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 369/734] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:33:55.432249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627ba7-0064-411e-bc11-6e97b06a221b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.432746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627ba7-0064-411e-bc11-6e97b06a221b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.433226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627ba7-0064-411e-bc11-6e97b06a221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.452810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c9627ba7-0064-411e-bc11-6e97b06a221b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:55.454468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c9627ba7-0064-411e-bc11-6e97b06a221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:55.464080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.529061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8176a-3dc6-4969-83e2-775fddcd03e9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.554425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.560405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 370/735] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:55.561537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9627ba7-0064-411e-bc11-6e97b06a221b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.577467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.578436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.579057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.579490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.580803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:55.581561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.583331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.599831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 366/736] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:55.605084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.689925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9627ba7-0064-411e-bc11-6e97b06a221b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.729008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.729954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.730372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.730747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.746403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.748186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.759157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336e14c-fe11-4ebb-9914-5dacf7cbd5be None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:55.774143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:55.775354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:55.776278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:55.776278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:55.776278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:55.776278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:55.776794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 371/737] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:55.777609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.778636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.804936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef843-025a-4217-bc47-b1d85bd0c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.807038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef843-025a-4217-bc47-b1d85bd0c10b None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.807616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef843-025a-4217-bc47-b1d85bd0c10b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.808378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef843-025a-4217-bc47-b1d85bd0c10b None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.809483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ef843-025a-4217-bc47-b1d85bd0c10b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.811772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ef843-025a-4217-bc47-b1d85bd0c10b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.844191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.892616 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e014cc-de45-4282-b352-47187ad614d8 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.909414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 367/738] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:33:55 2022] POST /identity/v3/services => generated 251 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:55.912048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef843-025a-4217-bc47-b1d85bd0c10b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.968169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.968991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.969277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.969555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] PATH_INFO: `/v3/users/swift` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.979264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.980727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:55.996849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:55.997882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:33:55.998876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:56.002928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 372/739] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:56.004686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:56.082200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef843-025a-4217-bc47-b1d85bd0c10b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:56.146898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:56.147667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.147933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.148293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.148977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:56.149287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:56.152461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:56.153143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3145a-47b6-4c1c-ace7-0a4a8a0bb74f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:56.166131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:56.172690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 368/740] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:56.174064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:56.199132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:56.199961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.200326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.200867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.201868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:56.202283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:56.204160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:56.216061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:56.227618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 373/741] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jul 11 14:33:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:56.236466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:56.313782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74831fb7-a479-431c-ace4-0344abf76136 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:56.351003 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a392c-0496-473c-a36d-bd61ac748342 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:56.359353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3c95e-4ead-4c48-b159-ddb3d9694726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:56.360158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3c95e-4ead-4c48-b159-ddb3d9694726 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.360435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3c95e-4ead-4c48-b159-ddb3d9694726 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.360712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3c95e-4ead-4c48-b159-ddb3d9694726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.373476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3c95e-4ead-4c48-b159-ddb3d9694726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:56.375438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3c95e-4ead-4c48-b159-ddb3d9694726 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-eab3c95e-4ead-4c48-b159-ddb3d9694726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:56.392721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:56.393700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:56.394655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:56.394655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:56.394655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:56.394655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:56.394655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:56.394655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:56.394655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:56.394655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:56.396916 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 369/742] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:56.398405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721e8f-bc8c-4227-a115-0210a1c93686 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.399437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721e8f-bc8c-4227-a115-0210a1c93686 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.399940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721e8f-bc8c-4227-a115-0210a1c93686 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.401685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 370/743] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:56.407499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb259b-bed7-48f4-af29-dd5e4a7f1edd None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.408416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb259b-bed7-48f4-af29-dd5e4a7f1edd None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.408416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb259b-bed7-48f4-af29-dd5e4a7f1edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.412099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e9668-2bee-4f64-aafc-698f908f2fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:56.415968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e9668-2bee-4f64-aafc-698f908f2fbe None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.415968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e9668-2bee-4f64-aafc-698f908f2fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.415968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e9668-2bee-4f64-aafc-698f908f2fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.428052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-e0fb259b-bed7-48f4-af29-dd5e4a7f1edd None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:56.429259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e0fb259b-bed7-48f4-af29-dd5e4a7f1edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:56.455860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:56.491777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e9668-2bee-4f64-aafc-698f908f2fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:56.493299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e9668-2bee-4f64-aafc-698f908f2fbe None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:56.534125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 371/744] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:33:56.534125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb259b-bed7-48f4-af29-dd5e4a7f1edd None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:56.551643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:56.622465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 374/745] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:56 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:33:56.623756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5aaa-b7ad-4bbe-b272-ae6fe97c4016 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.624051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5aaa-b7ad-4bbe-b272-ae6fe97c4016 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.624328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5aaa-b7ad-4bbe-b272-ae6fe97c4016 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.625624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 375/746] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:56.626328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c5aaa-b7ad-4bbe-b272-ae6fe97c4016 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:56.651871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb259b-bed7-48f4-af29-dd5e4a7f1edd None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:56.697876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:56.698673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.698961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.699240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.700035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:56.700348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:56.701777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:56.707147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:56.718394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 372/747] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:56.719880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:56.757956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c5aaa-b7ad-4bbe-b272-ae6fe97c4016 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:56.798624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c8082-a4dc-45aa-9b9c-c5192b03fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:56.799649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c8082-a4dc-45aa-9b9c-c5192b03fcc8 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.799940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c8082-a4dc-45aa-9b9c-c5192b03fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.800222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c8082-a4dc-45aa-9b9c-c5192b03fcc8 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.800954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c8082-a4dc-45aa-9b9c-c5192b03fcc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:56.802348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c8082-a4dc-45aa-9b9c-c5192b03fcc8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:56.820069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:56.839491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c0ef9-fe83-49c3-8174-15a4ce14cf37 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:56.877784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 376/748] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:33:56 2022] POST /identity/v3/services => generated 240 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:56.879439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17237-5559-4ce0-b9b7-41aafdc324ce None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:56.879870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17237-5559-4ce0-b9b7-41aafdc324ce None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:56.880286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17237-5559-4ce0-b9b7-41aafdc324ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:56.906694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0eb17237-5559-4ce0-b9b7-41aafdc324ce None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:56.908499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0eb17237-5559-4ce0-b9b7-41aafdc324ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:57.003251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:57.004058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.004343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.004621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.018779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 377/749] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:57.021598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb17237-5559-4ce0-b9b7-41aafdc324ce None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:57.027662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:57.033966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:57.055809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:57.056789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:57.057716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:57.057716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:57.057716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:57.057716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:57.060216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 373/750] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:57.061311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:57.095822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:57.160552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb17237-5559-4ce0-b9b7-41aafdc324ce None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:57.194941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6a31b-6d33-4dda-ae70-b23c1608492b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:57.202823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:57.203850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.204333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.204830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.205848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=159886720aa34b75b1ca092e1477b17e) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:57.206378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:57.208062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:57.214843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 378/751] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:57 2022] GET /identity/v3/role_assignments?user.id=159886720aa34b75b1ca092e1477b17e&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:57.215776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:57.232316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:57.239760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4006-6692-46da-a503-57ebbc6b6c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:57.240985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4006-6692-46da-a503-57ebbc6b6c19 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.241603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4006-6692-46da-a503-57ebbc6b6c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.242092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4006-6692-46da-a503-57ebbc6b6c19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.259799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb4006-6692-46da-a503-57ebbc6b6c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-b2cb4006-6692-46da-a503-57ebbc6b6c19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:57.270500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:57.271559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:57.272429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:57.276030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 374/752] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:57.283371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4006-6692-46da-a503-57ebbc6b6c19 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:57.441926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b496-2863-4e4f-9563-55e979a2f2f3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:57.470507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:57.481383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:57.482076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.482392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.482680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.483930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:57.484295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:57.494223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:57.500522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 379/753] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:57.506716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:57.526298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4006-6692-46da-a503-57ebbc6b6c19 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:57.624046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365f494-de81-4513-b32c-dfe83acd863a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:57.650861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:57.651557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.651849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.652132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.652895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:57.653209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:57.654636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:57.662556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:57.663509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.663909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.664298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.673546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:57.675560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:57.680956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 375/754] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:57.687076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:57.692208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:57.693300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:57.694464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:57.694464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:57.694464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:57.694464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:57.694464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:57.694464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:57.694464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:57.694464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:57.700863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 380/755] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:57.702164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:57.758497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:57.827064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e589cf-0650-4734-86b4-51d662772318 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:57.865177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:57.867024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:57.868024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.868420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.868826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.869742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:57.870193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:57.872065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:57.890339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 381/756] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:57.892655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:57.999582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:58.005654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3fa9f-3c17-4da1-8cf3-b49e04ab43de None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:58.015354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e80b3-0fc4-4092-9d69-38da9c124b8a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:58.043229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:58.044158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.044631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.045040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.046033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=0c3a489751424d008dbfefa89d19883a) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:58.046475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:58.048101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:58.062291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 382/757] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:57 2022] GET /identity/v3/role_assignments?user.id=0c3a489751424d008dbfefa89d19883a&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:58.072473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02972818-071a-4cb2-849d-fe8609068422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:58.073306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02972818-071a-4cb2-849d-fe8609068422 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.073586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02972818-071a-4cb2-849d-fe8609068422 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.073859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02972818-071a-4cb2-849d-fe8609068422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.095619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02972818-071a-4cb2-849d-fe8609068422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:58.097090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02972818-071a-4cb2-849d-fe8609068422 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-02972818-071a-4cb2-849d-fe8609068422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:58.129922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:58.130993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:58.131934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:58.131934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:58.131934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:58.131934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:58.131934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 376/758] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:58.140477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:58.314339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051841de-59f0-492c-acf8-7870ce83dc52 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:58.319743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b452-46b6-4393-946c-07229496c51c None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.321291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b452-46b6-4393-946c-07229496c51c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.321824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b452-46b6-4393-946c-07229496c51c None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.323988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 377/759] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:58.330277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368e07-5186-4ae9-9da0-da63584c0ee6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.330947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368e07-5186-4ae9-9da0-da63584c0ee6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.331451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368e07-5186-4ae9-9da0-da63584c0ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.350399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a2368e07-5186-4ae9-9da0-da63584c0ee6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:58.352189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a2368e07-5186-4ae9-9da0-da63584c0ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:58.364957 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:58.365632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.365918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.366229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.366970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:58.367397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:58.368814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:58.390162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 383/760] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:58.391434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:58.421746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:58.452545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 378/761] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:33:58.500038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368e07-5186-4ae9-9da0-da63584c0ee6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:58.538519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc5c8-63bd-46d0-be76-d077b80a66af None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:58.567195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:58.594664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:58.595520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.595807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.596085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.610265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:58.611748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:58.638315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:58.640038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:33:58.641030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:58.643203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 384/762] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:33:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:58.649529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:58.690833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368e07-5186-4ae9-9da0-da63584c0ee6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:58.737188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:58.737188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.737188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.737188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.737617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:58.737617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:58.761282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:58.762307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:33:58.763186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 379/763] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jul 11 14:33:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:58.768842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:58.796958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:58.819040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6431a-4c94-465f-ac19-fb731536ba6f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:58.857484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:58.858829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.859619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.860390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.862055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:58.862617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:58.864293 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:58.884476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 385/764] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:33:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:58.890412 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:58.999409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a705ad-3f30-4fce-9efc-f14e4bbf7f87 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.011868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:59.024352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f927f-56cb-402d-b8ad-88ae3e1f2d78 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.037237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.038282 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.038678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.039082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.046926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:59.051898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.053596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:59.073675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:59.074841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:59.076002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:59.076002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:59.076002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:59.076002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:59.077636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 386/765] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:59.083234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:59.116956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.118268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.118561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.118837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.119560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:59.119871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.121255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.137162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 380/766] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jul 11 14:33:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:59.143195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:59.192698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247140c-432c-44cc-9469-6c0cc6cef85a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.230506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.231352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.231747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.232133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.232971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:59.233404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.234900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.247423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 387/767] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:59.252905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:59.307664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:59.363215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201cac-a609-4577-8650-349dd5858947 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.407190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.407866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.408152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.408434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.409149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:59.409463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.410859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.419121 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0bdc-2c7b-4766-b4f4-5dbd31baa99f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.425082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 381/768] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jul 11 14:33:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:59.431114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:59.463810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:59.473753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea78eb-fe12-4d1e-804a-768b3dc9e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.474596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea78eb-fe12-4d1e-804a-768b3dc9e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.474880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea78eb-fe12-4d1e-804a-768b3dc9e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.475161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea78eb-fe12-4d1e-804a-768b3dc9e9e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.483704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea78eb-fe12-4d1e-804a-768b3dc9e9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.485466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea78eb-fe12-4d1e-804a-768b3dc9e9e8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-abea78eb-fe12-4d1e-804a-768b3dc9e9e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:59.500951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:59.501962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:33:59.502908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 388/769] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:59.504964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d556-3db9-45c2-b281-98e46b0c60d6 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.504964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d556-3db9-45c2-b281-98e46b0c60d6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.504964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d556-3db9-45c2-b281-98e46b0c60d6 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.506143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 389/770] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:59.509248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22d556-3db9-45c2-b281-98e46b0c60d6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:59.573979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659570e-d7e5-4ab0-814c-4dc708fc3f95 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.620240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d766a-3a73-4cd5-990d-f72a05c9ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.620953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d766a-3a73-4cd5-990d-f72a05c9ab0c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.621239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d766a-3a73-4cd5-990d-f72a05c9ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.621526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d766a-3a73-4cd5-990d-f72a05c9ab0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.622379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d766a-3a73-4cd5-990d-f72a05c9ab0c None admin] RBAC: Adding query filter params (interface=public, service_id=7f063b3426ce40d79fb4f8d28208fafa, region_id=RegionOne) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:59.622693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d766a-3a73-4cd5-990d-f72a05c9ab0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.624089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d766a-3a73-4cd5-990d-f72a05c9ab0c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.631760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 382/771] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Jul 11 14:33:59 2022] GET /identity/v3/endpoints?service_id=7f063b3426ce40d79fb4f8d28208fafa&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:59.633044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e65c4-57af-4d00-a822-8f4f5cab2efb None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.633863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e65c4-57af-4d00-a822-8f4f5cab2efb None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.634216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e65c4-57af-4d00-a822-8f4f5cab2efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.646997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22d556-3db9-45c2-b281-98e46b0c60d6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.652428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d66e65c4-57af-4d00-a822-8f4f5cab2efb None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:59.653698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d66e65c4-57af-4d00-a822-8f4f5cab2efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:59.659985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:59.683902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4abe0-d0c2-4e41-83aa-17d578206f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.684567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4abe0-d0c2-4e41-83aa-17d578206f65 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.684851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4abe0-d0c2-4e41-83aa-17d578206f65 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.685129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4abe0-d0c2-4e41-83aa-17d578206f65 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.685918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4abe0-d0c2-4e41-83aa-17d578206f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:59.686262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4abe0-d0c2-4e41-83aa-17d578206f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.687694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4abe0-d0c2-4e41-83aa-17d578206f65 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.706461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 390/772] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:59.706461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e05fa-62cb-4ed9-8551-1d56a62d8bf5 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.706461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e05fa-62cb-4ed9-8551-1d56a62d8bf5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.706461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e05fa-62cb-4ed9-8551-1d56a62d8bf5 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.706461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 391/773] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:59.707488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e05fa-62cb-4ed9-8551-1d56a62d8bf5 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:59.746125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 383/774] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:59.746125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e65c4-57af-4d00-a822-8f4f5cab2efb None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:59.774568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:59.829496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e05fa-62cb-4ed9-8551-1d56a62d8bf5 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.860559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e65c4-57af-4d00-a822-8f4f5cab2efb None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:59.866377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a111ef-3120-466b-9181-2f9958f70c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.867046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a111ef-3120-466b-9181-2f9958f70c84 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.867332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a111ef-3120-466b-9181-2f9958f70c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.867691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a111ef-3120-466b-9181-2f9958f70c84 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.868369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a111ef-3120-466b-9181-2f9958f70c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.869825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a111ef-3120-466b-9181-2f9958f70c84 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.881670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 392/775] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:33:59 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:59.881670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2269-e59e-481b-96a7-a468650fbf1b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.881670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2269-e59e-481b-96a7-a468650fbf1b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.881670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2269-e59e-481b-96a7-a468650fbf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.902222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-50ae2269-e59e-481b-96a7-a468650fbf1b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:59.903960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-50ae2269-e59e-481b-96a7-a468650fbf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:59.906824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254f20-8075-4725-93d1-110fee9c39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:59.907857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254f20-8075-4725-93d1-110fee9c39e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:59.908394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254f20-8075-4725-93d1-110fee9c39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:59.908670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254f20-8075-4725-93d1-110fee9c39e0 None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/035eeee0a72449358827a34bb09aa057/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:59.911264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29254f20-8075-4725-93d1-110fee9c39e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=035eeee0a72449358827a34bb09aa057, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:59.912742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29254f20-8075-4725-93d1-110fee9c39e0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:59.937752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:59.986072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 393/776] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:59.986072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2269-e59e-481b-96a7-a468650fbf1b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.020969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 384/777] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:59 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/035eeee0a72449358827a34bb09aa057/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:34:00.024619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254f20-8075-4725-93d1-110fee9c39e0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.130534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2269-e59e-481b-96a7-a468650fbf1b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:00.141042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:00.164117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254f20-8075-4725-93d1-110fee9c39e0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:00.172652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:00.174463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.174830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.175210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.175979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:00.178497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:00.195665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:00.197254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:00.198163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 394/778] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:59 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:00.206213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.214870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861c0f2-1d1e-49ee-83ff-92414c3e641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:00.215696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c0f2-1d1e-49ee-83ff-92414c3e641c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.216043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c0f2-1d1e-49ee-83ff-92414c3e641c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.216330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c0f2-1d1e-49ee-83ff-92414c3e641c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.227918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861c0f2-1d1e-49ee-83ff-92414c3e641c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-8861c0f2-1d1e-49ee-83ff-92414c3e641c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:00.236171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:00.237244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:00.238129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 385/779] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:00.241463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:00.250186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861c0f2-1d1e-49ee-83ff-92414c3e641c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.324149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dee5f-813d-43f8-9dab-747a3b84d4c7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:00.365538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:00.366240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.366528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.366807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.368159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] RBAC: Adding query filter params (name=network) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:00.368529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:00.369920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:00.375782 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 395/780] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:00.387383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.392321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861c0f2-1d1e-49ee-83ff-92414c3e641c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:00.431871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:00.432550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.432837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.433117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.433874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:00.434979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:00.436413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:00.457939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 386/781] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:00.458875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.466471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:00.561398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:00.580076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7e20b-b84f-43af-b346-6e0d3d9245fa None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:00.609936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648b96-9dcc-4e36-969b-c5b1b105ff8b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:00.651349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:00.651993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.652237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.652522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.653239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] RBAC: Adding query filter params (type=network) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:00.653549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:00.657440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:00.660372 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:00.661180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.661465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.661746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.673791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 396/782] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:00.677401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:00.678895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:00.681248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:00.715756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:00.716746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:00.717691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:00.717691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:00.717691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:00.717691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:00.728142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 387/783] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:00.729088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.806166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:00.860505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac41f2f-3e4f-422c-94bc-c95cb8ed09b4 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:00.902613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba6105-e9ad-4955-b020-44dadc3d080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:00.903879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6105-e9ad-4955-b020-44dadc3d080b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.904319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6105-e9ad-4955-b020-44dadc3d080b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.905000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6105-e9ad-4955-b020-44dadc3d080b None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.906426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba6105-e9ad-4955-b020-44dadc3d080b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:00.907245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba6105-e9ad-4955-b020-44dadc3d080b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:00.909071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba6105-e9ad-4955-b020-44dadc3d080b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:00.925664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8a32-b9cd-4739-94bc-bb0cf0efc278 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:00.926304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 388/784] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:00.929080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277671-ce44-4683-9b90-6f6662e76d25 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.929607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277671-ce44-4683-9b90-6f6662e76d25 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.930241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277671-ce44-4683-9b90-6f6662e76d25 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.937029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 389/785] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:00.937029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277671-ce44-4683-9b90-6f6662e76d25 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.967405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d5fb1-0bc3-4018-9dbe-b02683145460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:00.968272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d5fb1-0bc3-4018-9dbe-b02683145460 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.968561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d5fb1-0bc3-4018-9dbe-b02683145460 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.968841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d5fb1-0bc3-4018-9dbe-b02683145460 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.970005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d5fb1-0bc3-4018-9dbe-b02683145460 None admin] RBAC: Adding query filter params (interface=public, service_id=2c6649b422fa47be8319ec75569b8def, region_id=RegionOne) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:00.970357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d5fb1-0bc3-4018-9dbe-b02683145460 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:00.972038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d5fb1-0bc3-4018-9dbe-b02683145460 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:00.984289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 397/786] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/endpoints?service_id=2c6649b422fa47be8319ec75569b8def&interface=public®ion_id=RegionOne => generated 194 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:00.985652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500b2d-8186-43d7-9481-d1f56bf4b7fc None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.985946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500b2d-8186-43d7-9481-d1f56bf4b7fc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.986254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500b2d-8186-43d7-9481-d1f56bf4b7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.007885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c0500b2d-8186-43d7-9481-d1f56bf4b7fc None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:01.009549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c0500b2d-8186-43d7-9481-d1f56bf4b7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:01.028857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.073727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277671-ce44-4683-9b90-6f6662e76d25 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.089925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.110322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 398/787] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:01.110322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0500b2d-8186-43d7-9481-d1f56bf4b7fc None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.139580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.140868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.140868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.141210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.150296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:01.151897 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:01.168802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:01.169817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 390/788] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:01.172034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.243383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0500b2d-8186-43d7-9481-d1f56bf4b7fc None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.282151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730fda-458b-4eaa-8fda-b70cf1530f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.283326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730fda-458b-4eaa-8fda-b70cf1530f2a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.284124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730fda-458b-4eaa-8fda-b70cf1530f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.284641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730fda-458b-4eaa-8fda-b70cf1530f2a None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.285577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730fda-458b-4eaa-8fda-b70cf1530f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:01.287499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730fda-458b-4eaa-8fda-b70cf1530f2a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:01.290545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5cff6-3235-4a9a-8d7a-08f1228aa11e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.294766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 399/789] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:01.296019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730fda-458b-4eaa-8fda-b70cf1530f2a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.314901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.332365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db1b4c-bd3d-4a2b-9caa-2cb8e98f0707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.333469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1b4c-bd3d-4a2b-9caa-2cb8e98f0707 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.333901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1b4c-bd3d-4a2b-9caa-2cb8e98f0707 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.334385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1b4c-bd3d-4a2b-9caa-2cb8e98f0707 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.349241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db1b4c-bd3d-4a2b-9caa-2cb8e98f0707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-f1db1b4c-bd3d-4a2b-9caa-2cb8e98f0707 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:01.361053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:01.362356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:01.363439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:01.366523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 391/790] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:01.372670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db1b4c-bd3d-4a2b-9caa-2cb8e98f0707 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.450772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.453463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730fda-458b-4eaa-8fda-b70cf1530f2a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.530184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.531235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.532619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.533137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.534224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:01.534764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:01.536413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:01.560028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 400/791] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:01.566154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.577201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db1b4c-bd3d-4a2b-9caa-2cb8e98f0707 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.630810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.631502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.631791 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.632071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.632827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:01.633758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:01.635185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:01.650462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 392/792] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:01.651951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.653066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.698705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56255249-bf8b-4518-b8da-a4874e43ee0b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.744120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.744893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.745185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.745464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.766019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:01.767563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:01.795750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:01.801715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:01.802654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:01.803601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:01.803601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:01.803601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:01.803601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:01.803829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a18b1-57e2-455c-9ff5-09dbff2f16f8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.810766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 401/793] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:01.819135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.839237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.840031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.840590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.840590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.851531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:01.853458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:01.873716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:01.878882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:01.880021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:01.880021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:01.880021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:01.880021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:01.880021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 393/794] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:01.880390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.989028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a48a12-e9c1-40a6-b52d-231e601dac57 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.010899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3dfad-d44b-4af3-98ac-38d04875fcdb None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.033747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.034813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.035380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.035666 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.036405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:02.036870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.038649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.062467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.064712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 394/795] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:02.071388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.078942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.092834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.092834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.092834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.092834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:02.092834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.092834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.093298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.114054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 402/796] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:02.121294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.188066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00475cb9-359f-45f1-90e5-aad778fba501 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.225491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.226343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.226680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.227013 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.236341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.237800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:02.253012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:02.254023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:02.256173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 395/797] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:34:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:02.260158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.333779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.370803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba31b-a887-4ad7-acb8-dcf770247e60 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.382011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c2538-4aa3-418a-8eee-eae27ce7992a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.408799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.409476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.409765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.410046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.410929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:02.411244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.412743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.432543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 396/798] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jul 11 14:34:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:02.438054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.475807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b9a0b-c830-4190-97ad-3f3243f0da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.476692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b9a0b-c830-4190-97ad-3f3243f0da99 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.477566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b9a0b-c830-4190-97ad-3f3243f0da99 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.477849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b9a0b-c830-4190-97ad-3f3243f0da99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.495691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b9a0b-c830-4190-97ad-3f3243f0da99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.497221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b9a0b-c830-4190-97ad-3f3243f0da99 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-ba7b9a0b-c830-4190-97ad-3f3243f0da99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:02.516713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:02.517759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 403/799] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395119-ce24-4621-b396-cdd997a55a77 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.520450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395119-ce24-4621-b396-cdd997a55a77 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.521076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395119-ce24-4621-b396-cdd997a55a77 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.522006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 404/800] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:02.526139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5894dbf-f904-43e3-906a-923614b52d7b None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.526139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5894dbf-f904-43e3-906a-923614b52d7b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.526139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5894dbf-f904-43e3-906a-923614b52d7b None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.526139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 405/801] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:02.526139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5894dbf-f904-43e3-906a-923614b52d7b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.558710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6a47b-ef95-415f-acf5-6df5fe36b508 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.580785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.596199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.600956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0fb39-f140-49f8-b983-d7aa358a227f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.601756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0fb39-f140-49f8-b983-d7aa358a227f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.602016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0fb39-f140-49f8-b983-d7aa358a227f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.602411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0fb39-f140-49f8-b983-d7aa358a227f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.612933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0fb39-f140-49f8-b983-d7aa358a227f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.614413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0fb39-f140-49f8-b983-d7aa358a227f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-90e0fb39-f140-49f8-b983-d7aa358a227f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:02.631864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:02.632833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:02.635481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:02.635481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:02.635481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:02.635481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:02.635481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 397/802] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:02.635481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7231ea-7dcb-4f3c-adb6-2596f572b644 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.635481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7231ea-7dcb-4f3c-adb6-2596f572b644 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.636313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7231ea-7dcb-4f3c-adb6-2596f572b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.649460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5894dbf-f904-43e3-906a-923614b52d7b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.657127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-6d7231ea-7dcb-4f3c-adb6-2596f572b644 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:02.658418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6d7231ea-7dcb-4f3c-adb6-2596f572b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:02.685357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3c007-1a7b-4eca-8b87-8d7b39266b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.686082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c007-1a7b-4eca-8b87-8d7b39266b74 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.686331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c007-1a7b-4eca-8b87-8d7b39266b74 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.686609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c007-1a7b-4eca-8b87-8d7b39266b74 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.687398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c007-1a7b-4eca-8b87-8d7b39266b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:02.687703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c007-1a7b-4eca-8b87-8d7b39266b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.689126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c007-1a7b-4eca-8b87-8d7b39266b74 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.702392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 406/803] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:02.703780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9373c-6bed-4ce5-b041-fb75fe3bc1df None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.704067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9373c-6bed-4ce5-b041-fb75fe3bc1df None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.704341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9373c-6bed-4ce5-b041-fb75fe3bc1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.722972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-61b9373c-6bed-4ce5-b041-fb75fe3bc1df None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:02.724158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-61b9373c-6bed-4ce5-b041-fb75fe3bc1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:02.754731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 398/804] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:02.754731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7231ea-7dcb-4f3c-adb6-2596f572b644 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.811204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 407/805] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:02.812385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9373c-6bed-4ce5-b041-fb75fe3bc1df None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.853547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.862702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7231ea-7dcb-4f3c-adb6-2596f572b644 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.872999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.900258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.901005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.901364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.901699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.902523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:02.902893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.904326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.917743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 399/806] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:02.918662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.930494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9373c-6bed-4ce5-b041-fb75fe3bc1df None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.966675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960b4a9-235b-48cd-9b79-0c18327be2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.967665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960b4a9-235b-48cd-9b79-0c18327be2db None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.968031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960b4a9-235b-48cd-9b79-0c18327be2db None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.968434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960b4a9-235b-48cd-9b79-0c18327be2db None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/159886720aa34b75b1ca092e1477b17e/roles/af9f77c3be4c47969788085eedea854d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.985069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960b4a9-235b-48cd-9b79-0c18327be2db None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=159886720aa34b75b1ca092e1477b17e, role_id=af9f77c3be4c47969788085eedea854d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.986651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960b4a9-235b-48cd-9b79-0c18327be2db None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.026922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139b2e6-a680-4d75-a516-a69c0f4904af None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.055477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 408/807] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:34:02 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/159886720aa34b75b1ca092e1477b17e/roles/af9f77c3be4c47969788085eedea854d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:34:03.056323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960b4a9-235b-48cd-9b79-0c18327be2db None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.072261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.073202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.073554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.073896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.074718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:03.076208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:03.091570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:03.092831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:34:03.093940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:03.096548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 400/808] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jul 11 14:34:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:03.097595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.137297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:03.182210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:03.201317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960b4a9-235b-48cd-9b79-0c18327be2db None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.225853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa4806-3f15-4441-9b69-d3c14e92dd01 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.241522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c79f32-9fd2-4c65-b103-177bb0db317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.242978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c79f32-9fd2-4c65-b103-177bb0db317c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.243269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c79f32-9fd2-4c65-b103-177bb0db317c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.243550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c79f32-9fd2-4c65-b103-177bb0db317c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.256728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c79f32-9fd2-4c65-b103-177bb0db317c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-25c79f32-9fd2-4c65-b103-177bb0db317c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:03.265761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:03.266807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 409/809] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:03.268178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c79f32-9fd2-4c65-b103-177bb0db317c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.269710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.270971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.270971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.270971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.279581 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:03.282227 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:03.308049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:03.309017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 401/810] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:03.310999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.393238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c79f32-9fd2-4c65-b103-177bb0db317c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.444490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:03.445549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.446730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.447074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.447360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.448093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:03.448422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:03.450749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.455685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4738e-5dc3-448d-a28b-739012ce4143 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.457006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 410/811] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:03.458068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.472598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:03.495402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.496486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.497028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.497505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.498544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:03.499443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:03.501486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.516696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 402/812] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:03.518391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.594305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2e4f5-b9cd-4a03-b080-5d0c48c35d4c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.639134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.639816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.640105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.640385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.641470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:03.641786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:03.643982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.646753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed7663-6262-4923-9a61-c0c1b9c5e9e4 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.660713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 411/813] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:03.661598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.689657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.690749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.691263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.691739 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.692645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:03.693206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:03.694798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.701138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 403/814] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:03.702424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.725094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:03.759078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:03.809928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5eb2c-90fc-4c7b-b68b-7c00c0354d82 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.833728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce7327-28c6-4d70-8746-1ea8d06405a8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.853599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.854438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.854725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.855065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.869513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:03.871064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.871599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df575ccd-b177-4034-8c4c-ef768ea23233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.872485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df575ccd-b177-4034-8c4c-ef768ea23233 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.872761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df575ccd-b177-4034-8c4c-ef768ea23233 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.873052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df575ccd-b177-4034-8c4c-ef768ea23233 None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/0c3a489751424d008dbfefa89d19883a/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.875037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df575ccd-b177-4034-8c4c-ef768ea23233 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=0c3a489751424d008dbfefa89d19883a, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:03.876679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df575ccd-b177-4034-8c4c-ef768ea23233 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:03.891000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:03.892031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:03.892929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:03.892929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:03.892929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:03.892929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:03.892929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 412/815] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:03.893333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.949082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 404/816] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:34:03 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/0c3a489751424d008dbfefa89d19883a/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:34:03.949082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f360af-6934-4af0-99be-cf996687d83d None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.949082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f360af-6934-4af0-99be-cf996687d83d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.949082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f360af-6934-4af0-99be-cf996687d83d None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.949082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 405/817] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:03.949082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f360af-6934-4af0-99be-cf996687d83d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.026627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a944-fee9-409e-84d2-3641a4bace72 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:04.053320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.062892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.073567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f32e-3bae-4b96-8c33-d2d593a6ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:04.074531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f32e-3bae-4b96-8c33-d2d593a6ceb4 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.074887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f32e-3bae-4b96-8c33-d2d593a6ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.075290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f32e-3bae-4b96-8c33-d2d593a6ceb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.076777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035f32e-3bae-4b96-8c33-d2d593a6ceb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.078612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035f32e-3bae-4b96-8c33-d2d593a6ceb4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.094534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f360af-6934-4af0-99be-cf996687d83d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:04.140058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89609a50-31fd-4095-904d-5d9012d91806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:04.140743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609a50-31fd-4095-904d-5d9012d91806 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.141026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609a50-31fd-4095-904d-5d9012d91806 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.141302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609a50-31fd-4095-904d-5d9012d91806 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.142032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89609a50-31fd-4095-904d-5d9012d91806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:04.142390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89609a50-31fd-4095-904d-5d9012d91806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.143794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89609a50-31fd-4095-904d-5d9012d91806 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.156489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 406/818] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:04.157779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefed43-ff15-4808-b0aa-9bf3ce072857 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.158075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefed43-ff15-4808-b0aa-9bf3ce072857 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.158373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefed43-ff15-4808-b0aa-9bf3ce072857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.176140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-baefed43-ff15-4808-b0aa-9bf3ce072857 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:04.177350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-baefed43-ff15-4808-b0aa-9bf3ce072857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:04.188179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 413/819] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:34:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:04.189124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f32e-3bae-4b96-8c33-d2d593a6ceb4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.321152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 407/820] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:04.351327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefed43-ff15-4808-b0aa-9bf3ce072857 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.354939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f32e-3bae-4b96-8c33-d2d593a6ceb4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:04.428626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:04.429440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.429731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.430645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] PATH_INFO: `/v3/users/nova` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.440581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.442947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.453305 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:04.462794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:04.463855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:04.464865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 414/821] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:34:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:04.469655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.513050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefed43-ff15-4808-b0aa-9bf3ce072857 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:04.528559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.562419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:04.564913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.565517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.566001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] PATH_INFO: `/v3/services/network` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.567160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.569688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:04.584772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:04.586674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:34:04.587793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:04.593217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 408/822] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:04 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:04.594837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.628274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fe219-3aff-49de-b254-f9ec61ea69db None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:04.714881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:04.715088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0a56-57de-42d1-8327-405afb0269f3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:04.716395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.716946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.717422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.718498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:04.719079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.720787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.751126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.760315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:04.761215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.761652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.762137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.762900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 415/823] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:34:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:04.763559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] RBAC: Adding query filter params (name=network) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:04.764327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.765858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.769146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.772508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 409/824] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:04.778876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.891925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819ad5-429c-4b52-b758-fd4fcf61291b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:04.934130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:04.934130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.934130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.934130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.934584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] RBAC: Adding query filter params (type=network) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:04.934584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.934584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.943091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 410/825] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:04.944362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.966841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.984254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86136b4f-8544-419c-9f48-648110db7b1c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:05.009834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:05.058261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139f2cf-ac60-4234-b640-33099738990e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:05.059343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805a24-8556-4ff7-ab9e-113c65ebaab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:05.060082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805a24-8556-4ff7-ab9e-113c65ebaab4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.060990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805a24-8556-4ff7-ab9e-113c65ebaab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.061344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805a24-8556-4ff7-ab9e-113c65ebaab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.097139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0faec0-9de0-4678-8fea-eccb4e4cf364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:05.098270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0faec0-9de0-4678-8fea-eccb4e4cf364 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.098742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0faec0-9de0-4678-8fea-eccb4e4cf364 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.099222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0faec0-9de0-4678-8fea-eccb4e4cf364 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.100274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0faec0-9de0-4678-8fea-eccb4e4cf364 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:05.101863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0faec0-9de0-4678-8fea-eccb4e4cf364 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:05.159417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805a24-8556-4ff7-ab9e-113c65ebaab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:05.161245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805a24-8556-4ff7-ab9e-113c65ebaab4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:05.215903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 411/826] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:34:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:05.267204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:05.275158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 416/827] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:34:05.280880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0faec0-9de0-4678-8fea-eccb4e4cf364 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:05.429400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0faec0-9de0-4678-8fea-eccb4e4cf364 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:05.440710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:05.468940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:05.469759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.470045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.470352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.478054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22074bf-df16-40b8-8e6c-80c176d7b7d9 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.478390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22074bf-df16-40b8-8e6c-80c176d7b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.478672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22074bf-df16-40b8-8e6c-80c176d7b7d9 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.480243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 417/828] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:05.482074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:05.483616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:05.495627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d4f52-6a8f-4f25-b3ff-71ee9428d4b0 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.495944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d4f52-6a8f-4f25-b3ff-71ee9428d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.496182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d4f52-6a8f-4f25-b3ff-71ee9428d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:05.504261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:05.505244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:05.506242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:05.506242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:05.506242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:05.506242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:05.506473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 412/829] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:05.513350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:05.538406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-483d4f52-6a8f-4f25-b3ff-71ee9428d4b0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:05.539694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-483d4f52-6a8f-4f25-b3ff-71ee9428d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:05.635950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 418/830] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:05.656273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac807af5-5cc3-485b-8077-6e9bd8c1b7c7 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:05.662604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d4f52-6a8f-4f25-b3ff-71ee9428d4b0 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:05.707289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:05.707878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.708165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.708481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.709220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:05.709868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:05.712196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:05.728605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 413/831] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:05.737350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:05.771811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:05.810773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d4f52-6a8f-4f25-b3ff-71ee9428d4b0 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:05.839777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:05.855841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e86d28-a2b7-484b-929d-6cd614a99d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:05.856648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86d28-a2b7-484b-929d-6cd614a99d6e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.856929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86d28-a2b7-484b-929d-6cd614a99d6e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.857205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86d28-a2b7-484b-929d-6cd614a99d6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.870120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e86d28-a2b7-484b-929d-6cd614a99d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:05.874380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ca3bb-ee0c-44b0-8378-bac332849556 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e7e86d28-a2b7-484b-929d-6cd614a99d6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:05.879252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:05.880464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:34:05.881706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:05.885919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 419/832] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:05.887020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e86d28-a2b7-484b-929d-6cd614a99d6e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:05.920445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:05.921700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.922182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.922651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.931162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:05.932994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:05.949506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:05.950712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:05.951855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:05.951855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:05.951855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:05.951855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:05.951855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:05.951855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:05.951855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:05.951855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:05.954007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 414/833] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:05.966241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:05.997137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e86d28-a2b7-484b-929d-6cd614a99d6e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.034304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.034971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.035255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.035529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.036278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:06.036583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.038048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.051776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 420/834] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:34:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:06.052628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.075193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.102196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f02e7-f9af-490e-929c-d786938b4125 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.111451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.160145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.161215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.161733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.162823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.163983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:06.164586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.166917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.177715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595504b8-c497-49cb-9b9a-b224fbafecbf None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.189226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 415/835] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:06.189923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.228289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d915ce-3aa6-4a1c-8a1d-1885e52d6510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.230449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d915ce-3aa6-4a1c-8a1d-1885e52d6510 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.230743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d915ce-3aa6-4a1c-8a1d-1885e52d6510 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.231022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d915ce-3aa6-4a1c-8a1d-1885e52d6510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.248848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d915ce-3aa6-4a1c-8a1d-1885e52d6510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.250281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d915ce-3aa6-4a1c-8a1d-1885e52d6510 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-18d915ce-3aa6-4a1c-8a1d-1885e52d6510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:06.270661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:06.271677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:06.272615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:06.272615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:06.272615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:06.272615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:06.272615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 421/836] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:06.273481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220184-b641-43e7-8832-b0287e00e7cf None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.274126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220184-b641-43e7-8832-b0287e00e7cf None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.274472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220184-b641-43e7-8832-b0287e00e7cf None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.275984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 422/837] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:06.279920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220184-b641-43e7-8832-b0287e00e7cf None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.314050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae08db9-9d38-484a-b703-8bc3b2cd6c3b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.351037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9bdd6-b75e-4e4f-acb2-6698d2c727ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.352415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9bdd6-b75e-4e4f-acb2-6698d2c727ca None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.352658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9bdd6-b75e-4e4f-acb2-6698d2c727ca None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.352938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9bdd6-b75e-4e4f-acb2-6698d2c727ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.353773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9bdd6-b75e-4e4f-acb2-6698d2c727ca None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=035eeee0a72449358827a34bb09aa057) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:06.354081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9bdd6-b75e-4e4f-acb2-6698d2c727ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.355536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9bdd6-b75e-4e4f-acb2-6698d2c727ca None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.363047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 416/838] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/role_assignments?user.id=035eeee0a72449358827a34bb09aa057&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:06.364274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47742d-1c89-4b03-89aa-acd90cab1aae None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.364556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47742d-1c89-4b03-89aa-acd90cab1aae None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.364827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47742d-1c89-4b03-89aa-acd90cab1aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.373870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.385615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-5a47742d-1c89-4b03-89aa-acd90cab1aae None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:06.386902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5a47742d-1c89-4b03-89aa-acd90cab1aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:06.400085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.407839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220184-b641-43e7-8832-b0287e00e7cf None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.451471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.452109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.452447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.452724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.453830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:06.454161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.458552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.472512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 423/839] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:06.481754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.483324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 417/840] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:06.507894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47742d-1c89-4b03-89aa-acd90cab1aae None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.602789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a9aa1-3835-4870-9118-48348d61ab14 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.643295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47742d-1c89-4b03-89aa-acd90cab1aae None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.644338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.645329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.646226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.646537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.659844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.661725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:06.680467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:06.681519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:06.682617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:06.685317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 424/841] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:06.687146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf43c-49df-4413-a8d8-4d600a0d379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.688011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf43c-49df-4413-a8d8-4d600a0d379d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.688358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf43c-49df-4413-a8d8-4d600a0d379d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.688697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf43c-49df-4413-a8d8-4d600a0d379d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.690424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.690905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.701416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf43c-49df-4413-a8d8-4d600a0d379d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-97eaf43c-49df-4413-a8d8-4d600a0d379d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:06.710748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:06.712725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:06.713579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 418/842] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:06.714776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008099-1481-4d61-8d36-4c9879669ce0 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.714776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008099-1481-4d61-8d36-4c9879669ce0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.714776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008099-1481-4d61-8d36-4c9879669ce0 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.715997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 419/843] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:06.719218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008099-1481-4d61-8d36-4c9879669ce0 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.722806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.821119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3673ec-90e2-4f7e-bf85-6ea535ab2523 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.845333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008099-1481-4d61-8d36-4c9879669ce0 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.857560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389c00-c191-44cf-88e9-338afcbc96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.858265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389c00-c191-44cf-88e9-338afcbc96d4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.858556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389c00-c191-44cf-88e9-338afcbc96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.858837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389c00-c191-44cf-88e9-338afcbc96d4 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.859680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0389c00-c191-44cf-88e9-338afcbc96d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:06.859995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0389c00-c191-44cf-88e9-338afcbc96d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.861422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0389c00-c191-44cf-88e9-338afcbc96d4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.879234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 425/844] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:06.880568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad10ee-23a7-4e8e-ab0b-8bba7b2b4548 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.880863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad10ee-23a7-4e8e-ab0b-8bba7b2b4548 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.881139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad10ee-23a7-4e8e-ab0b-8bba7b2b4548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.894362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.895033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.895314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.895588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.896324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:06.896627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.898037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.899173 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b5ad10ee-23a7-4e8e-ab0b-8bba7b2b4548 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:06.900360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b5ad10ee-23a7-4e8e-ab0b-8bba7b2b4548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:06.911962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 420/845] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:06.911962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.971020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.989228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 426/846] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:06.989228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad10ee-23a7-4e8e-ab0b-8bba7b2b4548 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:06.999647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:07.025267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30400b42-03f2-41c2-b9f7-4c238411e838 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.062430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b3fe-3d5c-49b3-a263-350e144571fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.063089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b3fe-3d5c-49b3-a263-350e144571fb None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.063370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b3fe-3d5c-49b3-a263-350e144571fb None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.063718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b3fe-3d5c-49b3-a263-350e144571fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.114746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad10ee-23a7-4e8e-ab0b-8bba7b2b4548 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.143040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91b3fe-3d5c-49b3-a263-350e144571fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.144630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91b3fe-3d5c-49b3-a263-350e144571fb None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.152735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.153986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.154325 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.154834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.167569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.170018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:07.196903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:07.198096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:07.199075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:07.199075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:07.199075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:07.199075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:07.199075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 427/847] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:07.199372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.226265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:07.274488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:07.285652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 421/848] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:34:07.285652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b3fe-3d5c-49b3-a263-350e144571fb None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.323002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c79c-854b-47a9-b151-547465da2dbc None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.358871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.359868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.360192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.360478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.361134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.362538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:07.375238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:07.376485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:07.377580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 428/849] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:07.378688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.402353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b3fe-3d5c-49b3-a263-350e144571fb None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.448995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.449626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.449914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.450387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.450966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:07.451258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.452623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.471564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 422/850] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:07.471564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.493802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:07.496406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f626c0-7f04-4049-b8ac-36b2181f63b3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.521577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:07.533638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.534414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.534708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.534982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.547388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.549766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:07.569544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:07.571713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:07.573189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:07.573189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:07.573189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:07.573189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:07.573189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 429/851] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:07.573483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.597727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86139878-48df-4adf-8366-c39831fd50a1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.641654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.642600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.643064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.643335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.644042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:07.644349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.645703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.650964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 423/852] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:07.651747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.713393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a8a0-f022-4829-b3d2-57fe2a9453b1 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.765429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.767105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.767399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.767678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] PATH_INFO: `/v3/users/swift` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.776881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.778348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.782216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:07.796127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:07.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 430/853] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:07.798241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.806992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5fa9d-d73e-4e15-ab86-bdb923181d9c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.837634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:07.850989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.852226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.852511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.852784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.853509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:07.853877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.855352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.868638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 424/854] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:07.873655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.910036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e56c7-d399-41f7-8157-1f23ca68346c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.947374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.948039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.948329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.948613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.949960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:07.949960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:07.950987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:07.955789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 431/855] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:07.963164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.986811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447d75-dac6-47fe-9878-36511c68261a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:08.030346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:08.031039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.031324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.031599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.032467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:08.033056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.034396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:08.047815 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:08.062287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 425/856] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:08.063272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:08.110068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:08.117190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8325a4e-3f6f-4693-bf6e-4eff989c113f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:08.160892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:08.162380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.162740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.163090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.174403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.176015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:08.190877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b551a-2559-4152-9341-0b9b663ca2bf None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:08.197388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:08.198370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:08.199925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 432/857] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:08.204820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:08.248602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf8d2-a8f3-4eb0-9d53-d0db383813f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:08.249777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf8d2-a8f3-4eb0-9d53-d0db383813f3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.250342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf8d2-a8f3-4eb0-9d53-d0db383813f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.250851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf8d2-a8f3-4eb0-9d53-d0db383813f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.336704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e049-4b4c-4f1a-8679-805c7c386e03 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:08.341522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:08.345544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf8d2-a8f3-4eb0-9d53-d0db383813f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.347048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf8d2-a8f3-4eb0-9d53-d0db383813f3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:08.393287 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:08.394402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.394902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.395405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.396896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:08.397441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.400343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:08.423408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 433/858] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:08.425021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:08.447592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:08.486218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 426/859] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:34:08.493529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf8d2-a8f3-4eb0-9d53-d0db383813f3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:08.546774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba495b2-db6e-47e0-a17d-6e41d6150c11 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:08.587899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcc3f5-b8a1-475a-bdbb-8c5125d71d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:08.588480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcc3f5-b8a1-475a-bdbb-8c5125d71d83 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.588764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcc3f5-b8a1-475a-bdbb-8c5125d71d83 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.589041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcc3f5-b8a1-475a-bdbb-8c5125d71d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.589884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcc3f5-b8a1-475a-bdbb-8c5125d71d83 None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=159886720aa34b75b1ca092e1477b17e) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:08.590231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcc3f5-b8a1-475a-bdbb-8c5125d71d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.591801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcc3f5-b8a1-475a-bdbb-8c5125d71d83 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:08.600319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 434/860] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:08 2022] GET /identity/v3/role_assignments?user.id=159886720aa34b75b1ca092e1477b17e&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:08.601770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03250a1-78b8-4b6c-8456-4ab74a0fbbe7 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.602818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03250a1-78b8-4b6c-8456-4ab74a0fbbe7 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.602818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03250a1-78b8-4b6c-8456-4ab74a0fbbe7 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.604322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 435/861] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:08.612607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819e01-b2a5-45e6-8876-5c3f8aafd342 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.613149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819e01-b2a5-45e6-8876-5c3f8aafd342 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.613621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819e01-b2a5-45e6-8876-5c3f8aafd342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.628020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:08.634003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf8d2-a8f3-4eb0-9d53-d0db383813f3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:08.636654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-22819e01-b2a5-45e6-8876-5c3f8aafd342 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:08.638269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-22819e01-b2a5-45e6-8876-5c3f8aafd342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:08.688754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:08.690000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.690569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.690903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.704539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.706178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:08.727179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:08.728161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:08.729353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:08.729353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:08.729353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:08.729353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:08.729353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 427/862] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:08.735095 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:08.748229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 436/863] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:08.771915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819e01-b2a5-45e6-8876-5c3f8aafd342 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:08.789789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:08.890482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a28064-302e-4ca5-8967-5313687dabd7 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:08.925590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819e01-b2a5-45e6-8876-5c3f8aafd342 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:08.949623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:08.950447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.950732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.951121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.951735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:08.952043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.953575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:08.966670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 428/864] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:08.972464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:08.986718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:08.987021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:08.988198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.988784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.989168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.989844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.991442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:09.008654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:09.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:09.012001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 437/865] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jul 11 14:34:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:09.016053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:09.115458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff12ba-0702-45b2-8f66-41190f4b2b9e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:09.130017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:09.154441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba453572-6d02-432e-a7ab-4581f94cee88 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:09.166315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:09.167524 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:09.168027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:09.168948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:09.180745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:09.183513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:09.201680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:09.202744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:09.203215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:09.203463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:09.204363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:09.205294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:09.205294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:09.205294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:09.205294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:09.205294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:09.205294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:09.205294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:09.205294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:09.206505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:09.207497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:09.208016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:09.209633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:09.210201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 429/866] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:09.211261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:09.217559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 438/867] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:09.225206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:09.328011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:09.371225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac20a8-74cc-43c6-afe4-33400fe0e531 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:09.372084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58073b-d9dd-4c6a-89d3-e8227878d8b3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:09.417048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:09.417048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:09.417048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:09.417048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:09.417607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:09.417607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:09.418843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:09.420242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17324bd-8a4e-40c1-829b-dd38b1252863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:09.421785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17324bd-8a4e-40c1-829b-dd38b1252863 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:09.422558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17324bd-8a4e-40c1-829b-dd38b1252863 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:09.423045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17324bd-8a4e-40c1-829b-dd38b1252863 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:09.429829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 439/868] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:09.430551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17324bd-8a4e-40c1-829b-dd38b1252863 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:09.430551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17324bd-8a4e-40c1-829b-dd38b1252863 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:09.430551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17324bd-8a4e-40c1-829b-dd38b1252863 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:09.447024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 430/869] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:09.453189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:09.464090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:09.584388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156c03-086d-41c9-bd3f-662dab224d60 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:09.624024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650c3e-1601-4190-a941-7874bb0874f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:09.624689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650c3e-1601-4190-a941-7874bb0874f8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:09.624980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650c3e-1601-4190-a941-7874bb0874f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:09.625264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650c3e-1601-4190-a941-7874bb0874f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:09.626126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650c3e-1601-4190-a941-7874bb0874f8 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=0c3a489751424d008dbfefa89d19883a) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:09.626470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650c3e-1601-4190-a941-7874bb0874f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:09.627912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650c3e-1601-4190-a941-7874bb0874f8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:09.634598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 440/870] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:09 2022] GET /identity/v3/role_assignments?user.id=0c3a489751424d008dbfefa89d19883a&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:10.176655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d4de-248a-4c5a-805c-b2b41eecd41c None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:10.177183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d4de-248a-4c5a-805c-b2b41eecd41c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:10.177183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d4de-248a-4c5a-805c-b2b41eecd41c None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:10.179069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 431/871] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:10.184670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5d00-2304-488c-9aa0-d63696431477 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:10.185112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5d00-2304-488c-9aa0-d63696431477 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:10.185288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5d00-2304-488c-9aa0-d63696431477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:10.203030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-7dde5d00-2304-488c-9aa0-d63696431477 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:10.204229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7dde5d00-2304-488c-9aa0-d63696431477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:10.307995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:10.321965 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 441/872] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:10.377098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d4de-248a-4c5a-805c-b2b41eecd41c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:10.514324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d4de-248a-4c5a-805c-b2b41eecd41c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:10.546671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:10.552795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f738-350a-453a-996e-bca4f68deddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:10.553466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f738-350a-453a-996e-bca4f68deddf None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:10.553749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f738-350a-453a-996e-bca4f68deddf None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:10.554057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f738-350a-453a-996e-bca4f68deddf None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:10.555326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3f738-350a-453a-996e-bca4f68deddf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:10.556705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3f738-350a-453a-996e-bca4f68deddf None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:10.640624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 432/873] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:34:10 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:10.955481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9dbd5-448f-4a72-8546-8041189776d4 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:10.955867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9dbd5-448f-4a72-8546-8041189776d4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:10.956069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9dbd5-448f-4a72-8546-8041189776d4 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:10.957668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 442/874] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:10.963042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312adf7-56d2-41e2-bc1b-18091eda6cef None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:10.963327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312adf7-56d2-41e2-bc1b-18091eda6cef None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:10.963601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312adf7-56d2-41e2-bc1b-18091eda6cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:10.984857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d312adf7-56d2-41e2-bc1b-18091eda6cef None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:10.986083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d312adf7-56d2-41e2-bc1b-18091eda6cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:11.066284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 433/875] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:11.089843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9dbd5-448f-4a72-8546-8041189776d4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:11.196730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9dbd5-448f-4a72-8546-8041189776d4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:11.233256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902d6a6-e8c5-4cb4-b781-dc8a1a0e1f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:11.233988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902d6a6-e8c5-4cb4-b781-dc8a1a0e1f33 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.234298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902d6a6-e8c5-4cb4-b781-dc8a1a0e1f33 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.234571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902d6a6-e8c5-4cb4-b781-dc8a1a0e1f33 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.245463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902d6a6-e8c5-4cb4-b781-dc8a1a0e1f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-5902d6a6-e8c5-4cb4-b781-dc8a1a0e1f33 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:11.253843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:11.254837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:11.255722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 443/876] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jul 11 14:34:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:11.261245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312adf7-56d2-41e2-bc1b-18091eda6cef None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:11.373963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312adf7-56d2-41e2-bc1b-18091eda6cef None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:11.391679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:11.410733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:11.411415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.411701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.411984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.412741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:11.413057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:11.415140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:11.424413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 434/877] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Jul 11 14:34:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:11.429594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902d6a6-e8c5-4cb4-b781-dc8a1a0e1f33 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:11.497382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:11.544236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902d6a6-e8c5-4cb4-b781-dc8a1a0e1f33 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:11.582514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90706fd-5845-4273-bcde-693432df3766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:11.583684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90706fd-5845-4273-bcde-693432df3766 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.584177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90706fd-5845-4273-bcde-693432df3766 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.584659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90706fd-5845-4273-bcde-693432df3766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.597507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90706fd-5845-4273-bcde-693432df3766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:11.599288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90706fd-5845-4273-bcde-693432df3766 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-b90706fd-5845-4273-bcde-693432df3766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:11.617417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:11.618438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:11.619382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:11.619382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:11.619382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:11.619382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:11.621604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 444/878] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:11.627064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:11.642585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9475d-c2b7-4381-9da2-53c4dc468ac2 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.642893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9475d-c2b7-4381-9da2-53c4dc468ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.643157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9475d-c2b7-4381-9da2-53c4dc468ac2 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.644512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 445/879] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:11.650081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a8d1-6ea1-4616-912b-8717272c4698 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.650398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a8d1-6ea1-4616-912b-8717272c4698 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.650680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a8d1-6ea1-4616-912b-8717272c4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.670666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f770a8d1-6ea1-4616-912b-8717272c4698 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:11.671877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f770a8d1-6ea1-4616-912b-8717272c4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:11.762195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 446/880] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:11.762360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f9479-f02d-4c02-84a8-3df1eb03888d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:11.778899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770a8d1-6ea1-4616-912b-8717272c4698 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:11.800157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:11.801162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.801616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.802321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.803590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:11.804065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:11.806148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:11.823824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 435/881] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:11.829277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:11.834138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:11.873339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:11.898036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770a8d1-6ea1-4616-912b-8717272c4698 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:11.937247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cb103-7fdf-4609-9795-e1faa308a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:11.938472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb103-7fdf-4609-9795-e1faa308a891 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.938906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb103-7fdf-4609-9795-e1faa308a891 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.939328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb103-7fdf-4609-9795-e1faa308a891 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.940253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cb103-7fdf-4609-9795-e1faa308a891 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:11.940501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891a83a-4ae6-4aea-9565-7c02263f92ae None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:11.941931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cb103-7fdf-4609-9795-e1faa308a891 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:11.980840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd822f-9e89-4884-9828-6b61801c686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:11.981647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd822f-9e89-4884-9828-6b61801c686d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.981926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd822f-9e89-4884-9828-6b61801c686d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.982226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd822f-9e89-4884-9828-6b61801c686d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.989355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd822f-9e89-4884-9828-6b61801c686d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:11.990804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd822f-9e89-4884-9828-6b61801c686d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-d6bd822f-9e89-4884-9828-6b61801c686d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:12.005889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:12.013099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 436/882] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:34:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0159c6-315a-40c4-94ef-0dcb2c65f255 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.014762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0159c6-315a-40c4-94ef-0dcb2c65f255 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.015841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0159c6-315a-40c4-94ef-0dcb2c65f255 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.015841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 437/883] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:12.016043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0159c6-315a-40c4-94ef-0dcb2c65f255 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.054146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 447/884] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:34:11 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:34:12.054146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61782337-7905-47ae-8d58-23de096b5904 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.054146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61782337-7905-47ae-8d58-23de096b5904 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.054146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61782337-7905-47ae-8d58-23de096b5904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.070802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-61782337-7905-47ae-8d58-23de096b5904 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:12.072129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-61782337-7905-47ae-8d58-23de096b5904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:12.157991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:12.160146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 448/885] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:12.163991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0159c6-315a-40c4-94ef-0dcb2c65f255 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:12.184138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61782337-7905-47ae-8d58-23de096b5904 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.207460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:12.208144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.209219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.209501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.210371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:12.210682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:12.212695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:12.213833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:12.237970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 438/886] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:12.237970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.308480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61782337-7905-47ae-8d58-23de096b5904 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:12.347663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:12.348595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.348988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.349272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.349931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:12.351346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:12.364566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3245-cbf8-4134-952c-6a1808f51941 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:12.365063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:12.366028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:12.366914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 449/887] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:12.373844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.408186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed280c52-3dbc-4bb2-9ffe-e4f8bb42e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:12.408840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280c52-3dbc-4bb2-9ffe-e4f8bb42e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.409120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280c52-3dbc-4bb2-9ffe-e4f8bb42e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.409391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280c52-3dbc-4bb2-9ffe-e4f8bb42e3e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.442396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:12.490502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:12.491475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed280c52-3dbc-4bb2-9ffe-e4f8bb42e3e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:12.493264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed280c52-3dbc-4bb2-9ffe-e4f8bb42e3e3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:12.498754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29b49-b785-45a7-898c-77407d1abc5f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:12.544996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:12.545678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.545964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.546275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.547254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:12.547567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:12.549341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:12.560901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 450/888] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:12.563238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.611389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 439/889] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:34:12.619853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed280c52-3dbc-4bb2-9ffe-e4f8bb42e3e3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.679664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:12.699870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204efd-a77c-44fe-bc0e-3a1cd8e7f2d1 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:12.732595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed280c52-3dbc-4bb2-9ffe-e4f8bb42e3e3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:12.740975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:12.741650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.741933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.742836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.743701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:12.743962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:12.745347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:12.758900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 451/890] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:12.778267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef7b85-bb4d-4b47-9230-bea9ebe892a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:12.779487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7b85-bb4d-4b47-9230-bea9ebe892a7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.779975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7b85-bb4d-4b47-9230-bea9ebe892a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.780471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7b85-bb4d-4b47-9230-bea9ebe892a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.793446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef7b85-bb4d-4b47-9230-bea9ebe892a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:12.795308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef7b85-bb4d-4b47-9230-bea9ebe892a7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-36ef7b85-bb4d-4b47-9230-bea9ebe892a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:12.815895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:12.816833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:12.817753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:12.817753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:12.817753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:12.817753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:12.820185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 440/891] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:12.826958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.853859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:12.864183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841821f0-c51d-4cd0-b162-8c008b837de9 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.864788 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841821f0-c51d-4cd0-b162-8c008b837de9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.865419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841821f0-c51d-4cd0-b162-8c008b837de9 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.869808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 441/892] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:12.874148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3563781-27b0-48cd-9645-28d7ee661f88 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.874428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3563781-27b0-48cd-9645-28d7ee661f88 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.874740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3563781-27b0-48cd-9645-28d7ee661f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.894933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c3563781-27b0-48cd-9645-28d7ee661f88 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:12.896164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c3563781-27b0-48cd-9645-28d7ee661f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:12.962054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708300b-1054-40fb-ab25-b9ee265cb6a9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:12.975057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 442/893] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:12.997747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3563781-27b0-48cd-9645-28d7ee661f88 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.999286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:12.999954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.000238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.000518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.001239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:13.001547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.002937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.017341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 452/894] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:13.022601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:13.041331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:13.105186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3563781-27b0-48cd-9645-28d7ee661f88 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:13.111827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:13.136816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b903e2-c6ee-4659-8a10-407b64e9369e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:13.141680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:13.142519 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.142802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.143076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.143737 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.145124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:13.157613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:13.158706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:13.159552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 443/895] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:13.166808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:13.176049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:13.176851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.177132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.177405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.186217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.187812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:13.202489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:13.203546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:13.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:13.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:13.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:13.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:13.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:13.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:13.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:13.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:13.208455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 453/896] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:13.209497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:13.287032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df297ae-7c48-4a2f-9cf9-a0aec93e55b5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:13.290463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:13.320715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482330b-cee2-43c4-8e56-18748fd1c9cc None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:13.325609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:13.326429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.326826 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.327169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.327956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:13.328334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.329927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.335871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 444/897] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:13.341527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:13.365044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:13.365636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.365916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.366508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.367027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:13.367905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.369351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.377550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:13.389827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 454/898] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:13.393628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:13.462246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11a03f-202c-4411-b741-e916bb714160 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:13.500243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:13.501229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.501607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.502053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.502883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:13.503283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.504747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970bfdd-c1e2-434f-9fc7-480067fe9c3a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:13.504868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.515178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 445/899] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:13.516159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:13.544162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:13.544828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.545108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.545385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.546331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] RBAC: Adding query filter params (role.id=5d9ce550cedd4f21b5241d4a8f0c5f89, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=159886720aa34b75b1ca092e1477b17e) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:13.546731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.548355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.549889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:13.555362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 455/900] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:13 2022] GET /identity/v3/role_assignments?user.id=159886720aa34b75b1ca092e1477b17e&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=5d9ce550cedd4f21b5241d4a8f0c5f89 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:13.631353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352bf1c-8d7f-4bd4-9e7c-1a2f3a40f023 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:13.671555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8b98b-b01c-4289-9fe1-cba35468ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:13.672229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8b98b-b01c-4289-9fe1-cba35468ba49 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.672510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8b98b-b01c-4289-9fe1-cba35468ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.672780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8b98b-b01c-4289-9fe1-cba35468ba49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.673577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8b98b-b01c-4289-9fe1-cba35468ba49 None admin] RBAC: Adding query filter params (interface=public, service_id=791970b6e3b5499e8a43616990073be8, region_id=RegionOne) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:13.673887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8b98b-b01c-4289-9fe1-cba35468ba49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.675314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8b98b-b01c-4289-9fe1-cba35468ba49 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.681935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 446/901] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Jul 11 14:34:13 2022] GET /identity/v3/endpoints?service_id=791970b6e3b5499e8a43616990073be8&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:13.687776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:13.771180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:13.811036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6e689-70ba-4e23-89cf-fd58bdc4bb54 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:13.848535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ead22a-01e9-48bc-869e-50341c47f9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:13.849687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ead22a-01e9-48bc-869e-50341c47f9b8 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.850131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ead22a-01e9-48bc-869e-50341c47f9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.850406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ead22a-01e9-48bc-869e-50341c47f9b8 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.851093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ead22a-01e9-48bc-869e-50341c47f9b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:13.852516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ead22a-01e9-48bc-869e-50341c47f9b8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:13.859146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 456/902] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:34:13 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:34:14.222243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21b24-858f-488b-a034-d0829a8569b0 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:14.222740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21b24-858f-488b-a034-d0829a8569b0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:14.223127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21b24-858f-488b-a034-d0829a8569b0 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:14.224847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 447/903] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:14.230133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5de94-8dd6-4c68-87ae-aa8ead134cb2 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:14.230554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5de94-8dd6-4c68-87ae-aa8ead134cb2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:14.230932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5de94-8dd6-4c68-87ae-aa8ead134cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:14.248813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-cde5de94-8dd6-4c68-87ae-aa8ead134cb2 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:14.249998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cde5de94-8dd6-4c68-87ae-aa8ead134cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:14.327204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 457/904] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:14.349822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb21b24-858f-488b-a034-d0829a8569b0 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:14.449830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:14.457477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb21b24-858f-488b-a034-d0829a8569b0 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:14.491792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:14.493077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:14.493342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:14.493614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:14.494285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:14.495659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:14.508839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:14.509849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:14.510789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 448/905] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jul 11 14:34:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:14.516353 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5de94-8dd6-4c68-87ae-aa8ead134cb2 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:14.576628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:14.623057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5de94-8dd6-4c68-87ae-aa8ead134cb2 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:14.659650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:14.660320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:14.660600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:14.660875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:14.661579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:14.661883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:14.663326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:14.668444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 458/906] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:14.674283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:14.802445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf989-bf83-4fa2-b651-bd58d788c4ee None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:14.845116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851af265-076b-4075-aa51-5f622549bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:14.845792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851af265-076b-4075-aa51-5f622549bd1b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:14.846074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851af265-076b-4075-aa51-5f622549bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:14.846376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851af265-076b-4075-aa51-5f622549bd1b None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:14.847087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851af265-076b-4075-aa51-5f622549bd1b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:14.847489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851af265-076b-4075-aa51-5f622549bd1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:14.848880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851af265-076b-4075-aa51-5f622549bd1b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:14.855381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 449/907] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:14.861209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:14.906128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201524-c917-45a3-aa2f-94172089401a None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:14.906575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201524-c917-45a3-aa2f-94172089401a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:14.906863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201524-c917-45a3-aa2f-94172089401a None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:14.912285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 450/908] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:14.913977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70358b-5c24-48b1-bfe5-9bcf90aa09a2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:14.914426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70358b-5c24-48b1-bfe5-9bcf90aa09a2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:14.914856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70358b-5c24-48b1-bfe5-9bcf90aa09a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:14.938349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1c70358b-5c24-48b1-bfe5-9bcf90aa09a2 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:14.940593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1c70358b-5c24-48b1-bfe5-9bcf90aa09a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:14.965095 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:14.991818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041ffb0-25a4-464f-b213-a458eafaeb1c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:15.026786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 451/909] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:15.027287 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:15.038543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:15.039254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:15.043276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:15.043276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:15.043276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] RBAC: Adding query filter params (interface=public, service_id=13a14b97447d4eb5955970b18732c9cc, region_id=RegionOne) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:15.043276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:15.043276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:15.048468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 459/910] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Jul 11 14:34:14 2022] GET /identity/v3/endpoints?service_id=13a14b97447d4eb5955970b18732c9cc&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:15.051572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70358b-5c24-48b1-bfe5-9bcf90aa09a2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:15.061425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:15.160406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70358b-5c24-48b1-bfe5-9bcf90aa09a2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:15.170042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e857-d8f0-43d0-8f83-a9b738a725aa None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:15.199776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80992de3-75a4-4e42-bb8f-ac0d173154db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:15.200349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80992de3-75a4-4e42-bb8f-ac0d173154db None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:15.200638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80992de3-75a4-4e42-bb8f-ac0d173154db None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:15.200917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80992de3-75a4-4e42-bb8f-ac0d173154db None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:15.201676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80992de3-75a4-4e42-bb8f-ac0d173154db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:15.203147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80992de3-75a4-4e42-bb8f-ac0d173154db None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:15.209253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f16214-7094-4005-8349-3e71ecf573cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:15.210034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f16214-7094-4005-8349-3e71ecf573cb None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:15.210450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f16214-7094-4005-8349-3e71ecf573cb None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:15.210799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f16214-7094-4005-8349-3e71ecf573cb None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:15.211584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f16214-7094-4005-8349-3e71ecf573cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:15.213001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f16214-7094-4005-8349-3e71ecf573cb None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:15.218973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 460/911] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:34:15 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:34:15.263847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 452/912] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:34:15 2022] POST /identity/v3/services => generated 241 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:15.750488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea78c-bd54-495b-ad18-1b0d784b1339 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:15.751414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea78c-bd54-495b-ad18-1b0d784b1339 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:15.751908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea78c-bd54-495b-ad18-1b0d784b1339 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:15.753755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 461/913] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:15.758887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda42d-0198-41c2-8d78-de7af1c42ff3 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:15.759339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda42d-0198-41c2-8d78-de7af1c42ff3 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:15.759449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda42d-0198-41c2-8d78-de7af1c42ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:15.778812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-f3cda42d-0198-41c2-8d78-de7af1c42ff3 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:15.780346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f3cda42d-0198-41c2-8d78-de7af1c42ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:15.788757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:15.857399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 453/914] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:15.879384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea78c-bd54-495b-ad18-1b0d784b1339 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:15.934996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:15.990613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea78c-bd54-495b-ad18-1b0d784b1339 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.000283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82467-9b23-49e9-802c-0f6db64eb7ca None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.000561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82467-9b23-49e9-802c-0f6db64eb7ca None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.000763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82467-9b23-49e9-802c-0f6db64eb7ca None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.005890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 454/915] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:16.007275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d25f3-7037-45ad-823d-f85b15eb2515 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.007574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d25f3-7037-45ad-823d-f85b15eb2515 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.007874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d25f3-7037-45ad-823d-f85b15eb2515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.031424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ef0d25f3-7037-45ad-823d-f85b15eb2515 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:16.033116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ef0d25f3-7037-45ad-823d-f85b15eb2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:16.033768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c37548-5357-4f79-a5e5-2c11d937f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.034815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37548-5357-4f79-a5e5-2c11d937f27f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.035267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37548-5357-4f79-a5e5-2c11d937f27f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.035760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37548-5357-4f79-a5e5-2c11d937f27f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.050863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c37548-5357-4f79-a5e5-2c11d937f27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-15c37548-5357-4f79-a5e5-2c11d937f27f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:16.061341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:16.062644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:16.063599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 462/916] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jul 11 14:34:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:16.068340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c37548-5357-4f79-a5e5-2c11d937f27f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.112980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 455/917] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:16.139611 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d25f3-7037-45ad-823d-f85b15eb2515 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.196443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c37548-5357-4f79-a5e5-2c11d937f27f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.205642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:16.210749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:16.232837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.233508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.233795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.234071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.234869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:16.235178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.236550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.246741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 463/918] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:16.260759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.263052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d25f3-7037-45ad-823d-f85b15eb2515 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.301704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.302598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.302889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.304051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.304975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.306407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:16.321035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:16.322163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:34:16.323056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:16.327473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 456/919] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:16.328478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.362147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357e70-9bb0-4d02-878d-e2a7ebd23477 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.400086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.400894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.401182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.401455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.414572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.416124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:16.436064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:16.438217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:16.440526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:16.440526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:16.440526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:16.440526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:16.447820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 464/920] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:16.447820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.448338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946008a-af03-4e76-932c-ef3cd2083cc9 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.473102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:16.481250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:16.486993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.487917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.488407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.488877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.489795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:16.490335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.492063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.502181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 457/921] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:16.504029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.561160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9639a-a6f4-4b21-9928-471846db10e2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.599267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.599682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.599973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.600252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.600976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:16.601310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.603258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.613789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848bc7-7a8c-4496-a9a4-effa95de36f1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.621737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 465/922] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:16.622395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.650864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.651835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.652327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.652789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.653683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:16.654341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.655920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.666250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 458/923] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:16.668374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.713053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:16.741474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2893900-00d9-4c8a-a6a2-d9cd678b38c7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.762690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:16.782793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.783719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.784010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.784284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.793674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.795292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.800616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ad7fc-964c-4743-b374-fcae3f001a45 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:16.811622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:16.813539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 466/924] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:16.826496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.839703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133a98d-703c-445e-bb70-4eca6dde28bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.840616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a98d-703c-445e-bb70-4eca6dde28bb None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.840898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a98d-703c-445e-bb70-4eca6dde28bb None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.841290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a98d-703c-445e-bb70-4eca6dde28bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.842046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133a98d-703c-445e-bb70-4eca6dde28bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.843501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133a98d-703c-445e-bb70-4eca6dde28bb None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.950415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 459/925] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:34:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:16.958751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081e56e-ec38-41f9-8d94-f127590c286b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:17.012583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:17.013327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.013879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.014192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.015111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:17.015430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:17.016946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:17.032376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:17.068788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 467/926] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:17.075236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133a98d-703c-445e-bb70-4eca6dde28bb None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:17.196063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133a98d-703c-445e-bb70-4eca6dde28bb None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:17.214640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:17.233990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:17.234837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.235117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.235393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.247928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:17.249655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:17.269296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:17.271741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:17.273993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:17.273993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:17.273993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:17.273993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:17.273993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 460/927] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:17.279414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:17.395594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209899-5f38-492b-bf4c-89e3aa821f39 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:17.432305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e5edd-2833-4ec8-ab4c-5d42c1d9d192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:17.432971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e5edd-2833-4ec8-ab4c-5d42c1d9d192 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.433253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e5edd-2833-4ec8-ab4c-5d42c1d9d192 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.433530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e5edd-2833-4ec8-ab4c-5d42c1d9d192 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.434284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e5edd-2833-4ec8-ab4c-5d42c1d9d192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:17.434597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e5edd-2833-4ec8-ab4c-5d42c1d9d192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:17.436012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e5edd-2833-4ec8-ab4c-5d42c1d9d192 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:17.449753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 468/928] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:17.455169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:17.496131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace41322-e058-4c65-af9d-fe4e8840edb2 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.496467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace41322-e058-4c65-af9d-fe4e8840edb2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.496697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace41322-e058-4c65-af9d-fe4e8840edb2 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.499748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 469/929] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:17.504729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4df846-522d-4a59-8c81-3804a1dda32b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.505020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4df846-522d-4a59-8c81-3804a1dda32b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.505303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4df846-522d-4a59-8c81-3804a1dda32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.524057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6a4df846-522d-4a59-8c81-3804a1dda32b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:17.525275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6a4df846-522d-4a59-8c81-3804a1dda32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:17.585048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c890a-375f-40f3-be53-c28a30714ff1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:17.592589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:17.623490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 470/930] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:17.625569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333f3d-772b-40c3-87f1-750c7d167658 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.626645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333f3d-772b-40c3-87f1-750c7d167658 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.627678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333f3d-772b-40c3-87f1-750c7d167658 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.634188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 471/931] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:17.637167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae09bf7-8893-4222-98b4-e177ebce6f5b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.637638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae09bf7-8893-4222-98b4-e177ebce6f5b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.638830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae09bf7-8893-4222-98b4-e177ebce6f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.647746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:17.650542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.650542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.650542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.658704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:17.660177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:17.663516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-aae09bf7-8893-4222-98b4-e177ebce6f5b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:17.665342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-aae09bf7-8893-4222-98b4-e177ebce6f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:17.676268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:17.677427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:17.678616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:17.678616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:17.678616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:17.678616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:17.678616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:17.678616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:17.678616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:17.678616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:17.683620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 461/932] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:17.684554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:17.715754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:17.762151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 472/933] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:17.762909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae09bf7-8893-4222-98b4-e177ebce6f5b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:17.819989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e44c1-921a-4b99-b520-edbafa663e1c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:17.865005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:17.865838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.866122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.866424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.867092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:17.869081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:17.882138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:17.883246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:17.884110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 462/934] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jul 11 14:34:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:17.885308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:17.891396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae09bf7-8893-4222-98b4-e177ebce6f5b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:17.912972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:17.933379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:17.934059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:17.934364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:17.934649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:17.935441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:17.935755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:17.937179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:17.955743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 473/935] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:17.956554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:17.997676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:18.008499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820366-320d-4594-923d-e19d943d71bc None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.050350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.051165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.051436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.051741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.052354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.053839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:18.066406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:18.067532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:18.068419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 463/936] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:18.069263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:18.094188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bfb54-a2cc-41e2-b79a-ed16d41167e7 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.130590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.131265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.131552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.131833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.132553 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:18.132900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.134290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.139883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 474/937] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:18.145213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:18.203160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07636a9-4351-4190-9269-53ccdf0b9c8d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.204459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:18.259670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e3e1-e58a-41e6-a8ed-ae2952ca5769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.260575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e3e1-e58a-41e6-a8ed-ae2952ca5769 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.260861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e3e1-e58a-41e6-a8ed-ae2952ca5769 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.261143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e3e1-e58a-41e6-a8ed-ae2952ca5769 None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/159886720aa34b75b1ca092e1477b17e/roles/5d9ce550cedd4f21b5241d4a8f0c5f89` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.264300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9e3e1-e58a-41e6-a8ed-ae2952ca5769 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=159886720aa34b75b1ca092e1477b17e, role_id=5d9ce550cedd4f21b5241d4a8f0c5f89)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.265487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9e3e1-e58a-41e6-a8ed-ae2952ca5769 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.275176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc65ac-863e-4739-9e89-824e479523bd None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.310762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.311428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.311711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.311995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.312701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:18.313006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.314401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.319536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 475/938] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:18.320870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:18.381162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 464/939] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:34:18 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/159886720aa34b75b1ca092e1477b17e/roles/5d9ce550cedd4f21b5241d4a8f0c5f89 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:34:18.381849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e3e1-e58a-41e6-a8ed-ae2952ca5769 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:18.411534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:18.453843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3c72-b459-4494-8ec5-1fd7d904af1d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.456884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:18.499691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.500541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.500963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.501461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.502919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:18.502919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.504466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.511155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 476/940] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:18.519192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:18.536845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e3e1-e58a-41e6-a8ed-ae2952ca5769 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.588868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.589801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.590265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.590703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.591578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:18.592040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.593651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.605774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 465/941] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:18.612967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:18.668097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7d86c-a094-472c-81f6-93a01eb33b07 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.709771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:18.713642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adbd01-5a35-4fad-8c22-d55963187ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.714616 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adbd01-5a35-4fad-8c22-d55963187ff5 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.715104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adbd01-5a35-4fad-8c22-d55963187ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.715567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adbd01-5a35-4fad-8c22-d55963187ff5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.716505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adbd01-5a35-4fad-8c22-d55963187ff5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.718050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adbd01-5a35-4fad-8c22-d55963187ff5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.734741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fec39-d1a2-4473-99cb-558ff51e9b68 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.781630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.782308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.782598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.783343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.783687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] RBAC: Adding query filter params (interface=public, service_id=ca832e5f010e441f904831021e650ca0, region_id=RegionOne) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:18.783997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.785395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.792428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 466/942] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Jul 11 14:34:18 2022] GET /identity/v3/endpoints?service_id=ca832e5f010e441f904831021e650ca0&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:18.798022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:18.826830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 477/943] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:34:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:18.928457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c065bcd-0c00-4c0c-af59-7a3356b16cd3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:18.983874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516666bc-11c0-4c72-826d-81a8285ba3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:18.984938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516666bc-11c0-4c72-826d-81a8285ba3e8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:18.985439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516666bc-11c0-4c72-826d-81a8285ba3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:18.985922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516666bc-11c0-4c72-826d-81a8285ba3e8 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:18.986837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516666bc-11c0-4c72-826d-81a8285ba3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:18.988483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516666bc-11c0-4c72-826d-81a8285ba3e8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:18.996159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 467/944] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:34:18 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:34:19.201942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334396-ea0f-4ba4-b12c-dcfa358f5325 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:19.202527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334396-ea0f-4ba4-b12c-dcfa358f5325 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:19.202608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334396-ea0f-4ba4-b12c-dcfa358f5325 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:19.204183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 478/945] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:19.209772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a22f-ad24-4f6d-8992-8f8ad7835dde None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:19.210057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a22f-ad24-4f6d-8992-8f8ad7835dde None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:19.210364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a22f-ad24-4f6d-8992-8f8ad7835dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:19.216888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:19.227977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-f8c4a22f-ad24-4f6d-8992-8f8ad7835dde None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:19.231179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f8c4a22f-ad24-4f6d-8992-8f8ad7835dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:19.298468 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 468/946] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:19.321821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334396-ea0f-4ba4-b12c-dcfa358f5325 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:19.349779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:19.432273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334396-ea0f-4ba4-b12c-dcfa358f5325 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:19.468132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:19.468862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:19.469152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:19.469430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:19.470250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:19.471701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:19.473079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING keystone.server.flask.common [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 14:34:19.522180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.sql.core [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:34:19.522180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:34:19.522180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [parameters: {'id': 'ccd5ddc677454d47927f4eb16f142df6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:34:19.522180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87427) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ccd5ddc677454d47927f4eb16f142df6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ccd5ddc677454d47927f4eb16f142df6. Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:34:19.530318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result.read() Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 14:34:19.531177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application yield resource Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise self.value Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application session.commit() Jul 11 14:34:19.532185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:34:19.533118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:34:19.534085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result.read() Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:34:19.534939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [parameters: {'id': 'ccd5ddc677454d47927f4eb16f142df6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:19.535844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:19.536690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ccd5ddc677454d47927f4eb16f142df6. Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:19.537663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 479/947] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Jul 11 14:34:19 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:19.540470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4a22f-ad24-4f6d-8992-8f8ad7835dde None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:19.648713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4a22f-ad24-4f6d-8992-8f8ad7835dde None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:19.684844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c83df-ef4c-4383-bd9c-0b16aa7c8da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:19.685694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c83df-ef4c-4383-bd9c-0b16aa7c8da4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:19.685982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c83df-ef4c-4383-bd9c-0b16aa7c8da4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:19.686288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c83df-ef4c-4383-bd9c-0b16aa7c8da4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:19.688268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:19.693751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c83df-ef4c-4383-bd9c-0b16aa7c8da4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:19.695138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c83df-ef4c-4383-bd9c-0b16aa7c8da4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-586c83df-ef4c-4383-bd9c-0b16aa7c8da4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:19.710179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:19.712000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:19.713153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 469/948] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:19.717479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:19.822458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:19.842968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add10f9e-8a93-45ed-9900-9b930a79101b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:19.878319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a19e2e-9990-42f0-8d25-8337d92ec638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:19.879212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19e2e-9990-42f0-8d25-8337d92ec638 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:19.879661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19e2e-9990-42f0-8d25-8337d92ec638 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:19.880091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19e2e-9990-42f0-8d25-8337d92ec638 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:19.880991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a19e2e-9990-42f0-8d25-8337d92ec638 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:19.881462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a19e2e-9990-42f0-8d25-8337d92ec638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:19.883299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a19e2e-9990-42f0-8d25-8337d92ec638 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:19.904240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 480/949] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:20.568580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4945-7649-4cae-b891-82e579e27c7b None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:20.569118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4945-7649-4cae-b891-82e579e27c7b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:20.569449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4945-7649-4cae-b891-82e579e27c7b None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:20.571994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 470/950] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:20.577862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac62a-595c-4d5d-acd7-3ef9fbb9974b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:20.578379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac62a-595c-4d5d-acd7-3ef9fbb9974b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:20.578665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac62a-595c-4d5d-acd7-3ef9fbb9974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:20.597491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-cf9ac62a-595c-4d5d-acd7-3ef9fbb9974b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:20.599082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cf9ac62a-595c-4d5d-acd7-3ef9fbb9974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:20.675152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 481/951] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:20.699707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea4945-7649-4cae-b891-82e579e27c7b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:20.831764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea4945-7649-4cae-b891-82e579e27c7b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:20.868862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722962-7455-4787-a9ff-7e74da589486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:20.870041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722962-7455-4787-a9ff-7e74da589486 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:20.870585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722962-7455-4787-a9ff-7e74da589486 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:20.871083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722962-7455-4787-a9ff-7e74da589486 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:20.882043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c722962-7455-4787-a9ff-7e74da589486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-8c722962-7455-4787-a9ff-7e74da589486 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:20.891585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:20.892605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:20.893526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:20.896325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 471/952] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jul 11 14:34:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:20.903528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac62a-595c-4d5d-acd7-3ef9fbb9974b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:20.984171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:21.010644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac62a-595c-4d5d-acd7-3ef9fbb9974b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.048735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254a1bc-07b1-43d2-85e1-63eb97140758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:21.049423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254a1bc-07b1-43d2-85e1-63eb97140758 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.049706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254a1bc-07b1-43d2-85e1-63eb97140758 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.049986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254a1bc-07b1-43d2-85e1-63eb97140758 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.050776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254a1bc-07b1-43d2-85e1-63eb97140758 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:21.051083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254a1bc-07b1-43d2-85e1-63eb97140758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:21.052451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254a1bc-07b1-43d2-85e1-63eb97140758 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:21.062716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 482/953] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Jul 11 14:34:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:21.071763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722962-7455-4787-a9ff-7e74da589486 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.087629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff742-e229-4f10-8b91-96b2431878e3 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.088357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff742-e229-4f10-8b91-96b2431878e3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.088913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff742-e229-4f10-8b91-96b2431878e3 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.090960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 483/954] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:21.092727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ce4e-8a9d-4259-892e-e4078814d3dd None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.093273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ce4e-8a9d-4259-892e-e4078814d3dd None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.093854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ce4e-8a9d-4259-892e-e4078814d3dd None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.095559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 484/955] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:21.096931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb868-44e2-4a1d-968c-72ca2737e762 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.097440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb868-44e2-4a1d-968c-72ca2737e762 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.097972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb868-44e2-4a1d-968c-72ca2737e762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.119810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1c2eb868-44e2-4a1d-968c-72ca2737e762 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:21.120643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1c2eb868-44e2-4a1d-968c-72ca2737e762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:21.144870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:21.192843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722962-7455-4787-a9ff-7e74da589486 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.196247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 485/956] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:21.197728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6dc4-0c4d-4229-a0b3-90a15b606589 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.198022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6dc4-0c4d-4229-a0b3-90a15b606589 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.198323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6dc4-0c4d-4229-a0b3-90a15b606589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.215140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-798d6dc4-0c4d-4229-a0b3-90a15b606589 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:21.216337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-798d6dc4-0c4d-4229-a0b3-90a15b606589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:21.246408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:21.247205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.247488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.247769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.260137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:21.261635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:21.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:21.281319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:21.283097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:21.283097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:21.283097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:21.283097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:21.283097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 472/957] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:21.283097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.284035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:21.296976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 486/958] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:21.298121 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6dc4-0c4d-4229-a0b3-90a15b606589 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.394676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99d4c1-703a-4096-b32b-d4ef75558968 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.403479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:21.417625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6dc4-0c4d-4229-a0b3-90a15b606589 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.436895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:21.437702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.437989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.438300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.438969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:21.440343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:21.452616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:21.459194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:21.460286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 473/959] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:21.461379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.466585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:21.467247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.467607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.467901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.469149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:21.469627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:21.472357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:21.489428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 487/960] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:21.489428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.560404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:21.590274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ec15-fe61-4d61-8336-c800fda68375 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.612425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b271a8-99c2-4a8d-a3cc-439cbeb86e91 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.632568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:21.633531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.633818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.634115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.635187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:21.636306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:21.649908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:21.651194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:21.652265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:21.655088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:21.655617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.656158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.656158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.656325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 474/961] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:21.656883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:21.657069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.657213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:21.658610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:21.667210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 488/962] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:21.670671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.702737 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:21.790287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fa2b6-6682-4c79-9e75-312187a039b3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.807352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd408ac-d733-4477-9d34-0da01d49ee3d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.824391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:21.826748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:21.827609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.827890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.828167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.835649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:21.837625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:21.843555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:21.844364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:21.844747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:21.845127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:21.845954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:21.846381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:21.847842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:21.858241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 489/963] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:21.858411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:21.859428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:34:21.860660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:21.861346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.861434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 475/964] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:21.861434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:21.972406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b07b0-c2a1-410b-a446-c10f58bae6aa None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:21.978740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:21.986453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2a0cd-1f0d-4277-ba3c-1627287477f3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:22.009999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.010699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.011003 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.011260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.011974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:22.012282 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.013959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.019752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 490/965] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:22.020846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:22.027512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f4776-841b-4b08-ac68-912b4057197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.028205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f4776-841b-4b08-ac68-912b4057197f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.028486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f4776-841b-4b08-ac68-912b4057197f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.028761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f4776-841b-4b08-ac68-912b4057197f None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.029481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f4776-841b-4b08-ac68-912b4057197f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:22.029791 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f4776-841b-4b08-ac68-912b4057197f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.031318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f4776-841b-4b08-ac68-912b4057197f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.037318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 476/966] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:22.038757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656e0b9-b3ce-4cdb-809c-5f8e931f0a4a None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.039107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656e0b9-b3ce-4cdb-809c-5f8e931f0a4a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.039979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656e0b9-b3ce-4cdb-809c-5f8e931f0a4a None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.042269 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 477/967] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:22.044948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656e0b9-b3ce-4cdb-809c-5f8e931f0a4a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:22.086563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:22.153667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdedf87-5697-4572-a75b-23e11a625fd9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:22.165250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656e0b9-b3ce-4cdb-809c-5f8e931f0a4a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:22.196649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f72b4-e761-4547-8b96-7d6a81c25789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.197328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f72b4-e761-4547-8b96-7d6a81c25789 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.197616 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f72b4-e761-4547-8b96-7d6a81c25789 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.197897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f72b4-e761-4547-8b96-7d6a81c25789 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.198803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f72b4-e761-4547-8b96-7d6a81c25789 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:22.199116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f72b4-e761-4547-8b96-7d6a81c25789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.200542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f72b4-e761-4547-8b96-7d6a81c25789 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.207817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757ff68-8482-4730-bd0b-b285da3580f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.208482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ff68-8482-4730-bd0b-b285da3580f4 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.208769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ff68-8482-4730-bd0b-b285da3580f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.209049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ff68-8482-4730-bd0b-b285da3580f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.209790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757ff68-8482-4730-bd0b-b285da3580f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.211761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757ff68-8482-4730-bd0b-b285da3580f4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.220150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 491/968] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Jul 11 14:34:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:22.221712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547148-2e28-4c18-8365-8b1db7ef7416 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.222005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547148-2e28-4c18-8365-8b1db7ef7416 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.222402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547148-2e28-4c18-8365-8b1db7ef7416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.239441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0f547148-2e28-4c18-8365-8b1db7ef7416 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:22.240562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0f547148-2e28-4c18-8365-8b1db7ef7416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:22.306991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 478/969] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:34:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:34:22.307934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757ff68-8482-4730-bd0b-b285da3580f4 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:22.330274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:22.342294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 492/970] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:22.366945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f547148-2e28-4c18-8365-8b1db7ef7416 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:22.414397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:22.445755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757ff68-8482-4730-bd0b-b285da3580f4 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:22.489698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb118cc-9778-42c4-9fd1-79620f3d992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.492570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb118cc-9778-42c4-9fd1-79620f3d992f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.492570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb118cc-9778-42c4-9fd1-79620f3d992f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.492570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb118cc-9778-42c4-9fd1-79620f3d992f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.516519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f547148-2e28-4c18-8365-8b1db7ef7416 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:22.562762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.563452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.564182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.564488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.565507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.567723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.583554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb118cc-9778-42c4-9fd1-79620f3d992f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.585064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb118cc-9778-42c4-9fd1-79620f3d992f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.600960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:22.625835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.sql.core [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:34:22.625835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:34:22.625835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [parameters: {'user_id': 'ff106f8798cb48c48acf1d5938bf501a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:34:22.625835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87427) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result.read() Jul 11 14:34:22.637501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:34:22.638461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application yield resource Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise self.value Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application session.commit() Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:34:22.639722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:34:22.640687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:34:22.641716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application result.read() Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:34:22.643178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ff106f8798cb48c48acf1d5938bf501a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:22.644248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 14:34:22.645257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 14:34:22.646496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 14:34:22.646496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 14:34:22.646496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:34:22.646496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:34:22.646496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:34:22.646496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:22.649046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 493/971] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Jul 11 14:34:22 2022] POST /identity/v3/users => generated 160 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:22.657759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:22.699747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 479/972] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:22 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:34:22.705924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb118cc-9778-42c4-9fd1-79620f3d992f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:22.785639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:22.799267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcdcea-d98f-4232-9fd0-c767e9192eda None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:22.832787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb118cc-9778-42c4-9fd1-79620f3d992f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:22.847785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.849235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.849797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.852361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.855094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:22.869323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.872458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.879050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.880125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.881076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.881459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:22.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:22.895156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:34:22.896371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:22.897261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.898969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.899133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 494/973] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:34:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:22.904244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:22.919309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:22.920492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:22.921668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:22.921668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:22.921668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:22.921668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:22.923228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 480/974] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:22.931204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:23.038740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d32d-0501-4765-a7ee-121521e927ef None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:23.051021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be412-d6c4-4178-9b1f-c6c27138d7d2 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:23.105490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:23.106240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:23.106524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:23.106799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:23.107323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:23.107606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:23.108264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:23.108439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:23.108867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:23.109282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:23.109715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:23.110400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:23.110870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:23.112715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:23.129152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 481/975] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:23.138309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:23.157529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 495/976] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Jul 11 14:34:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:23.176363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:23.264653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662d9c-5faf-4515-8c22-49278afcb301 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:23.309458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:23.310326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:23.310799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:23.311279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:23.319396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:23.320922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:23.336874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:23.337867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:23.338846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 482/977] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:23.344124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:23.356647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:23.474411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3c22-b1e7-4da4-bb66-0ce94a9c8edf None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:23.516012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeb61a-7229-443f-9640-51cb96194ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:23.516680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb61a-7229-443f-9640-51cb96194ab6 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:23.516968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb61a-7229-443f-9640-51cb96194ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:23.517257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb61a-7229-443f-9640-51cb96194ab6 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:23.518183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeb61a-7229-443f-9640-51cb96194ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:23.518497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeb61a-7229-443f-9640-51cb96194ab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:23.519918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeb61a-7229-443f-9640-51cb96194ab6 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:23.536089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 496/978] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:23.543764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:23.657241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:23.674469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689210b-1a76-4af5-9f74-5d636c4f6ab1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:23.716808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa9507-aff7-4254-8814-5e69533adb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:23.717467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa9507-aff7-4254-8814-5e69533adb64 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:23.717759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa9507-aff7-4254-8814-5e69533adb64 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:23.718040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa9507-aff7-4254-8814-5e69533adb64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:23.718983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa9507-aff7-4254-8814-5e69533adb64 None admin] RBAC: Adding query filter params (role.id=5d9ce550cedd4f21b5241d4a8f0c5f89, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=159886720aa34b75b1ca092e1477b17e) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:23.719292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa9507-aff7-4254-8814-5e69533adb64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:23.720741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa9507-aff7-4254-8814-5e69533adb64 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:23.734205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 483/979] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:23 2022] GET /identity/v3/role_assignments?user.id=159886720aa34b75b1ca092e1477b17e&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=5d9ce550cedd4f21b5241d4a8f0c5f89 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:24.132635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3a88-5328-4e15-9341-f0075d28be24 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:24.133716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3a88-5328-4e15-9341-f0075d28be24 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:24.133821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3a88-5328-4e15-9341-f0075d28be24 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:24.135361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 497/980] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:24.140761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e928-6551-4d6a-b20e-d2f3b78a1403 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:24.141058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e928-6551-4d6a-b20e-d2f3b78a1403 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:24.141328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e928-6551-4d6a-b20e-d2f3b78a1403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:24.157767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1e21e928-6551-4d6a-b20e-d2f3b78a1403 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:24.158963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1e21e928-6551-4d6a-b20e-d2f3b78a1403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:24.226633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 484/981] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:24.249232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b3a88-5328-4e15-9341-f0075d28be24 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:24.322392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:24.356182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b3a88-5328-4e15-9341-f0075d28be24 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:24.390753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c889-6d1c-4203-bad9-1a55b094a7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:24.391539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c889-6d1c-4203-bad9-1a55b094a7ce None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:24.391830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c889-6d1c-4203-bad9-1a55b094a7ce None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:24.392561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c889-6d1c-4203-bad9-1a55b094a7ce None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:24.393454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c889-6d1c-4203-bad9-1a55b094a7ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:24.394832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c889-6d1c-4203-bad9-1a55b094a7ce None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:24.470159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 498/982] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:34:24 2022] POST /identity/v3/services => generated 242 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:24.515315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54f3f-ca58-4a32-aa9c-af67b7806498 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:24.515631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54f3f-ca58-4a32-aa9c-af67b7806498 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:24.515893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54f3f-ca58-4a32-aa9c-af67b7806498 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:24.517557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 485/983] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:24.523658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5093-2eb0-4aa2-a598-4480f4c8e32f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:24.523982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5093-2eb0-4aa2-a598-4480f4c8e32f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:24.524239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5093-2eb0-4aa2-a598-4480f4c8e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:24.543721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-a25f5093-2eb0-4aa2-a598-4480f4c8e32f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:24.545332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a25f5093-2eb0-4aa2-a598-4480f4c8e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:24.638173 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 499/984] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:24.662244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54f3f-ca58-4a32-aa9c-af67b7806498 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:24.760177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:24.780038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54f3f-ca58-4a32-aa9c-af67b7806498 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:24.817126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:24.817937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:24.818253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:24.818532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:24.819197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:24.821178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:24.833802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:24.835117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:24.841617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 486/985] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:24.844145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f5093-2eb0-4aa2-a598-4480f4c8e32f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:24.912836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:24.970370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f5093-2eb0-4aa2-a598-4480f4c8e32f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:25.012448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:25.013770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.014608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.015174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.016119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:25.016719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:25.018339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:25.024627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 500/986] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:25.030904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:25.136581 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe515a96-a078-4ef1-a0b6-0fe7ce837d05 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:25.170783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:25.171356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.171719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.172001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.172725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:25.173036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:25.174461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:25.179415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 487/987] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:25.185706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:25.287199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f89c-a41e-4122-837f-008549e297fb None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:25.305344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:25.322307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecac8f-dd33-4fbe-8f2d-50ecd7edad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:25.322969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecac8f-dd33-4fbe-8f2d-50ecd7edad0a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.323251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecac8f-dd33-4fbe-8f2d-50ecd7edad0a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.323526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecac8f-dd33-4fbe-8f2d-50ecd7edad0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.324320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecac8f-dd33-4fbe-8f2d-50ecd7edad0a None admin] RBAC: Adding query filter params (interface=admin, service_id=ca832e5f010e441f904831021e650ca0, region_id=RegionOne) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:25.324633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecac8f-dd33-4fbe-8f2d-50ecd7edad0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:25.325991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecac8f-dd33-4fbe-8f2d-50ecd7edad0a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:25.335722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 501/988] 10.222.0.20 () {56 vars in 1249 bytes} [Mon Jul 11 14:34:25 2022] GET /identity/v3/endpoints?service_id=ca832e5f010e441f904831021e650ca0&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:25.336871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:25.349096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:25.450210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b8b39-b032-4125-920d-2e171fbe31f1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:25.489699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec596fc-48fd-42eb-aec3-e733826cef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:25.490421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec596fc-48fd-42eb-aec3-e733826cef31 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.490705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec596fc-48fd-42eb-aec3-e733826cef31 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.491012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec596fc-48fd-42eb-aec3-e733826cef31 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.491670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec596fc-48fd-42eb-aec3-e733826cef31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:25.493087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec596fc-48fd-42eb-aec3-e733826cef31 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:25.500130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 488/989] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:34:25 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:34:25.834270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9d15-ba5f-4234-b698-c55033922846 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.834622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9d15-ba5f-4234-b698-c55033922846 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.834837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9d15-ba5f-4234-b698-c55033922846 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.836989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 502/990] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:25.842067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395d4c-bd31-45dc-8924-da766b59cc3b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.842777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395d4c-bd31-45dc-8924-da766b59cc3b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.842777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395d4c-bd31-45dc-8924-da766b59cc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.859174 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-21395d4c-bd31-45dc-8924-da766b59cc3b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:25.860362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-21395d4c-bd31-45dc-8924-da766b59cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:25.940774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 489/991] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:25.963952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9d15-ba5f-4234-b698-c55033922846 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:26.068611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9d15-ba5f-4234-b698-c55033922846 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:26.103260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:26.104046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:26.104327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:26.104602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] PATH_INFO: `/v3/services/image` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:26.105247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:26.106631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:26.118483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:26.119556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:26.120919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 503/992] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Jul 11 14:34:25 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:26.125475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21395d4c-bd31-45dc-8924-da766b59cc3b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:26.127699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:26.235729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21395d4c-bd31-45dc-8924-da766b59cc3b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:26.271549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b95a6-a179-420b-9284-4e5b2ddcbe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:26.272208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b95a6-a179-420b-9284-4e5b2ddcbe7d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:26.272490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b95a6-a179-420b-9284-4e5b2ddcbe7d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:26.272762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b95a6-a179-420b-9284-4e5b2ddcbe7d None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:26.273486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b95a6-a179-420b-9284-4e5b2ddcbe7d None admin] RBAC: Adding query filter params (name=image) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:26.273790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b95a6-a179-420b-9284-4e5b2ddcbe7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:26.275164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b95a6-a179-420b-9284-4e5b2ddcbe7d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:26.280068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 490/993] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:26.285401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:26.332241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:26.385880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce94aea-b59b-4bec-b9d8-39c2e9a6d03e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:26.420274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a32c2-4c9a-4524-8846-1d0098855dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:26.420880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a32c2-4c9a-4524-8846-1d0098855dd9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:26.421159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a32c2-4c9a-4524-8846-1d0098855dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:26.421431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a32c2-4c9a-4524-8846-1d0098855dd9 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:26.422227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a32c2-4c9a-4524-8846-1d0098855dd9 None admin] RBAC: Adding query filter params (type=image) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:26.422489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a32c2-4c9a-4524-8846-1d0098855dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:26.423826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a32c2-4c9a-4524-8846-1d0098855dd9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:26.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 504/994] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:26.565285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fb9d9-c7a3-4282-b03a-a66896af5b4e None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:26.565610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fb9d9-c7a3-4282-b03a-a66896af5b4e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:26.565835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fb9d9-c7a3-4282-b03a-a66896af5b4e None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:26.567534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 491/995] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:26.575240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d48f4-e1f2-4fd9-ad13-7aba6f649d88 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:26.575552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d48f4-e1f2-4fd9-ad13-7aba6f649d88 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:26.575838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d48f4-e1f2-4fd9-ad13-7aba6f649d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:26.593819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-209d48f4-e1f2-4fd9-ad13-7aba6f649d88 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:26.595019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-209d48f4-e1f2-4fd9-ad13-7aba6f649d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:26.675695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 505/996] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:26.698499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fb9d9-c7a3-4282-b03a-a66896af5b4e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:26.773527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:26.811559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fb9d9-c7a3-4282-b03a-a66896af5b4e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:26.852576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:26.853346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:26.853553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:26.853829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] PATH_INFO: `/v3/services/compute` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:26.854508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:26.855872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:26.870334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:26.871504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:26.872409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:26.874171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 492/997] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:26.878348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d48f4-e1f2-4fd9-ad13-7aba6f649d88 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:26.923844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:26.990525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d48f4-e1f2-4fd9-ad13-7aba6f649d88 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:27.027765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:27.028445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.028741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.029019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.029732 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:27.030044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:27.031456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:27.036909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 506/998] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:27.043588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:27.157825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f78d-c0ea-484b-902c-573f01ba1e3b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:27.187581 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:27.193866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:27.194561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.194850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.195155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.195866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:27.196178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:27.197537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:27.207405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 493/999] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:27.208668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:27.312238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e08290-f27d-45c7-89fe-1da6c2e69984 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:27.314623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:27.348514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e1d18-68ca-42fc-9602-046fd8b70c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:27.349176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1d18-68ca-42fc-9602-046fd8b70c29 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.349462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1d18-68ca-42fc-9602-046fd8b70c29 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.349736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1d18-68ca-42fc-9602-046fd8b70c29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.350576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e1d18-68ca-42fc-9602-046fd8b70c29 None admin] RBAC: Adding query filter params (interface=public, service_id=62ffb6f2337340de9139aa4f7d2612a9, region_id=RegionOne) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:27.350894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e1d18-68ca-42fc-9602-046fd8b70c29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:27.352272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e1d18-68ca-42fc-9602-046fd8b70c29 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:27.357547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 507/1000] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Jul 11 14:34:27 2022] GET /identity/v3/endpoints?service_id=62ffb6f2337340de9139aa4f7d2612a9&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:27.362846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:27.471352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a6696-b962-4803-b5c6-d4271363ae46 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:27.514067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d565-e05f-4290-bcf8-6ad50451c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:27.514779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d565-e05f-4290-bcf8-6ad50451c822 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.515061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d565-e05f-4290-bcf8-6ad50451c822 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.515333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d565-e05f-4290-bcf8-6ad50451c822 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.516009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390d565-e05f-4290-bcf8-6ad50451c822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:27.517401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390d565-e05f-4290-bcf8-6ad50451c822 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:27.524718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 494/1001] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:34:27 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:34:27.570037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476c89-d840-494d-ba18-787534a01117 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.570907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476c89-d840-494d-ba18-787534a01117 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.571176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476c89-d840-494d-ba18-787534a01117 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.572841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 508/1002] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:27.578557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88d9b7-cb48-4d03-8756-14a6ed7b2f7a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.578858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88d9b7-cb48-4d03-8756-14a6ed7b2f7a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.579136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88d9b7-cb48-4d03-8756-14a6ed7b2f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.597457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0f88d9b7-cb48-4d03-8756-14a6ed7b2f7a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:27.598705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0f88d9b7-cb48-4d03-8756-14a6ed7b2f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:27.657644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:27.672641 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 495/1003] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:27.696894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5476c89-d840-494d-ba18-787534a01117 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:27.808913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5476c89-d840-494d-ba18-787534a01117 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:27.844346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:27.845157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.845448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.845729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.846419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:27.847797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:27.860320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:27.861384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:27.862329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 509/1004] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jul 11 14:34:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:27.869958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88d9b7-cb48-4d03-8756-14a6ed7b2f7a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:27.979319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88d9b7-cb48-4d03-8756-14a6ed7b2f7a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:28.017249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:28.017929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:28.018305 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:28.018645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:28.019412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:28.019786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:28.021305 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:28.031227 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 496/1005] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:28.032477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:28.066899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:28.137867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aef24-87d2-4b66-8da2-cf5a7db27ef3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:28.173916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2702c9-3113-4f9c-bb0e-ed8e30ec5b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:28.174623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2702c9-3113-4f9c-bb0e-ed8e30ec5b54 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:28.174919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2702c9-3113-4f9c-bb0e-ed8e30ec5b54 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:28.175203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2702c9-3113-4f9c-bb0e-ed8e30ec5b54 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:28.175915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2702c9-3113-4f9c-bb0e-ed8e30ec5b54 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:28.176228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2702c9-3113-4f9c-bb0e-ed8e30ec5b54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:28.177601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2702c9-3113-4f9c-bb0e-ed8e30ec5b54 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:28.183615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 510/1006] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jul 11 14:34:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:28.189389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:28.245142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:28.294178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac638-cbaa-419d-9f74-fa510c70b40c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:28.328420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5554a9e-08f1-48a6-89f6-4b7bc6e43082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:28.329075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5554a9e-08f1-48a6-89f6-4b7bc6e43082 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:28.329361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5554a9e-08f1-48a6-89f6-4b7bc6e43082 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:28.329643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5554a9e-08f1-48a6-89f6-4b7bc6e43082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:28.330430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5554a9e-08f1-48a6-89f6-4b7bc6e43082 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:28.331795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5554a9e-08f1-48a6-89f6-4b7bc6e43082 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:28.408930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 497/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:34:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:28.507922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f75c0-81c5-4169-baae-2b061dd2ee8b None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:28.508445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f75c0-81c5-4169-baae-2b061dd2ee8b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:28.508524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f75c0-81c5-4169-baae-2b061dd2ee8b None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:28.510032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 511/1008] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:28.515960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d9d39-9d5c-4c2f-bee3-8768f495d24a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:28.516254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d9d39-9d5c-4c2f-bee3-8768f495d24a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:28.516536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d9d39-9d5c-4c2f-bee3-8768f495d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:28.535780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-321d9d39-9d5c-4c2f-bee3-8768f495d24a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:28.536999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-321d9d39-9d5c-4c2f-bee3-8768f495d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:28.627733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 498/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:28.652225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f75c0-81c5-4169-baae-2b061dd2ee8b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:28.778049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:28.785846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f75c0-81c5-4169-baae-2b061dd2ee8b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:28.833928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0be16-9071-4fcc-82d6-607c8e379fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:28.833928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0be16-9071-4fcc-82d6-607c8e379fe0 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:28.833928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0be16-9071-4fcc-82d6-607c8e379fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:28.833928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0be16-9071-4fcc-82d6-607c8e379fe0 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:28.834570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0be16-9071-4fcc-82d6-607c8e379fe0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:28.834678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0be16-9071-4fcc-82d6-607c8e379fe0 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:28.919609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 512/1010] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:34:28 2022] POST /identity/v3/services => generated 242 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:29.609560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83ffa-9392-4a13-be71-bd08b1d4665c None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:29.610085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83ffa-9392-4a13-be71-bd08b1d4665c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:29.610085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83ffa-9392-4a13-be71-bd08b1d4665c None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:29.611859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 499/1011] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:29.618050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f239a62-4b72-404d-bfcf-4a9abc80a1bc None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:29.618581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f239a62-4b72-404d-bfcf-4a9abc80a1bc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:29.618664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f239a62-4b72-404d-bfcf-4a9abc80a1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:29.636387 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6f239a62-4b72-404d-bfcf-4a9abc80a1bc None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:29.637580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6f239a62-4b72-404d-bfcf-4a9abc80a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:29.750075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 513/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:29 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:29.770428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83ffa-9392-4a13-be71-bd08b1d4665c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:29.828880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:29.915393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83ffa-9392-4a13-be71-bd08b1d4665c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:29.957206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:29.958015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:29.958500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:29.958653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:29.959248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:29.960628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:29.973106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:29.974250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:34:29.975163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:29.978461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 500/1013] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:29.980238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f239a62-4b72-404d-bfcf-4a9abc80a1bc None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:30.084630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:30.104497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f239a62-4b72-404d-bfcf-4a9abc80a1bc None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:30.161509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:30.162219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.163457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.163457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.163717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:30.164182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:30.166476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:30.174695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 514/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:30.182698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:30.310851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667230a-908a-4a4c-a73b-184a281db200 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:30.312951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:30.350424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e970f-aba1-46f3-845f-1029b295d265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:30.351875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e970f-aba1-46f3-845f-1029b295d265 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.352271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e970f-aba1-46f3-845f-1029b295d265 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.352656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e970f-aba1-46f3-845f-1029b295d265 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.353645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e970f-aba1-46f3-845f-1029b295d265 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:30.354069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e970f-aba1-46f3-845f-1029b295d265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:30.355986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e970f-aba1-46f3-845f-1029b295d265 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:30.368403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 501/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Jul 11 14:34:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:30.369618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:30.496678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87423a62-ae6e-4b33-85aa-ddfbf60c2ba9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:30.526716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e92513-f36d-4bd5-8838-3a6a4adb3fd4 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.527025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e92513-f36d-4bd5-8838-3a6a4adb3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.527275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e92513-f36d-4bd5-8838-3a6a4adb3fd4 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.528790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 502/1016] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:30.533793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb92-1690-4de9-985c-6b3d3c0b2ce9 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.534166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb92-1690-4de9-985c-6b3d3c0b2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.534374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb92-1690-4de9-985c-6b3d3c0b2ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.535393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4289-13d0-4448-9a0d-f5e264d52f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:30.536171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4289-13d0-4448-9a0d-f5e264d52f88 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.536473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4289-13d0-4448-9a0d-f5e264d52f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.536753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4289-13d0-4448-9a0d-f5e264d52f88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.537548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa4289-13d0-4448-9a0d-f5e264d52f88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:30.539503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa4289-13d0-4448-9a0d-f5e264d52f88 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:30.552060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-589ccb92-1690-4de9-985c-6b3d3c0b2ce9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:30.553245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-589ccb92-1690-4de9-985c-6b3d3c0b2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:30.623126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 503/1017] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:30.642529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 515/1018] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:34:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:30.651834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ccb92-1690-4de9-985c-6b3d3c0b2ce9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:30.768542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:30.775803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ccb92-1690-4de9-985c-6b3d3c0b2ce9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:30.823665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b109f1-1c0b-4d57-b507-bc36c17bf535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:30.824498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b109f1-1c0b-4d57-b507-bc36c17bf535 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.824833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b109f1-1c0b-4d57-b507-bc36c17bf535 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.825116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b109f1-1c0b-4d57-b507-bc36c17bf535 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.826488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b109f1-1c0b-4d57-b507-bc36c17bf535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:30.827850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b109f1-1c0b-4d57-b507-bc36c17bf535 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:30.829604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 504/1019] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:30.836254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4289-13d0-4448-9a0d-f5e264d52f88 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:30.839212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:30.949891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4289-13d0-4448-9a0d-f5e264d52f88 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:30.988848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684005d-9d67-4cf2-84d1-3ef412bb3b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:30.989535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684005d-9d67-4cf2-84d1-3ef412bb3b14 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.989823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684005d-9d67-4cf2-84d1-3ef412bb3b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.990119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684005d-9d67-4cf2-84d1-3ef412bb3b14 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.990850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684005d-9d67-4cf2-84d1-3ef412bb3b14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:30.992338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684005d-9d67-4cf2-84d1-3ef412bb3b14 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:31.027296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a5963-5464-4200-b143-cc45b2beca1a None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:31.027507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a5963-5464-4200-b143-cc45b2beca1a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:31.027782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a5963-5464-4200-b143-cc45b2beca1a None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:31.029151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 505/1020] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:31.034703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc73cc1-62ba-4a2e-8842-0f2a04e631ef None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:31.034989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc73cc1-62ba-4a2e-8842-0f2a04e631ef None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:31.035264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc73cc1-62ba-4a2e-8842-0f2a04e631ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:31.052186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7fc73cc1-62ba-4a2e-8842-0f2a04e631ef None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:31.053391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7fc73cc1-62ba-4a2e-8842-0f2a04e631ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:31.069421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 516/1021] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:34:30 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:34:31.134893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 506/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:31.158526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684005d-9d67-4cf2-84d1-3ef412bb3b14 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:31.219696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:31.267306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684005d-9d67-4cf2-84d1-3ef412bb3b14 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:31.303347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:31.304135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:31.304432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:31.305311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:31.305962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:31.307406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:31.319196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:31.320364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:31.321268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 517/1023] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Jul 11 14:34:31 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:31.326811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc73cc1-62ba-4a2e-8842-0f2a04e631ef None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:31.419646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:31.429206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc73cc1-62ba-4a2e-8842-0f2a04e631ef None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:31.463682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:31.464352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:31.464628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:31.464901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:31.465604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] RBAC: Adding query filter params (name=image) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:31.465910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:31.467326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:31.478193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 507/1024] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:31.479440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:31.583584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b9d1-aaaf-41be-8144-4fc9aedf09e5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:31.601326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:31.618701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:31.619371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:31.619659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:31.619940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:31.620651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] RBAC: Adding query filter params (type=image) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:31.620964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:31.622368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:31.632141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 518/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:31.633120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:31.738901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32828993-45b2-41db-a9d1-d9fb1fc85b8a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:31.783826 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9646df-f6f3-4db0-8f83-f96db83394be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:31.784725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9646df-f6f3-4db0-8f83-f96db83394be None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:31.785153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9646df-f6f3-4db0-8f83-f96db83394be None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:31.785607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9646df-f6f3-4db0-8f83-f96db83394be None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:31.786563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9646df-f6f3-4db0-8f83-f96db83394be None admin] RBAC: Adding query filter params (interface=public, service_id=c3f3177d48634179b79a2e8bd6062ef7, region_id=RegionOne) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:31.787021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9646df-f6f3-4db0-8f83-f96db83394be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:31.788511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9646df-f6f3-4db0-8f83-f96db83394be None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:31.799002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 508/1026] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Jul 11 14:34:31 2022] GET /identity/v3/endpoints?service_id=c3f3177d48634179b79a2e8bd6062ef7&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:31.800393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:31.910635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73c6bf-2395-41c1-ab44-cd1959724007 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:31.943745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06d795-aa82-4d48-98f8-cb61bd735574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:31.944414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d795-aa82-4d48-98f8-cb61bd735574 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:31.944702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d795-aa82-4d48-98f8-cb61bd735574 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:31.944981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d795-aa82-4d48-98f8-cb61bd735574 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:31.946182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06d795-aa82-4d48-98f8-cb61bd735574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:31.947630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06d795-aa82-4d48-98f8-cb61bd735574 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:31.962147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 519/1027] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:34:31 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:34:32.807443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fcc9-c1ec-46f5-891d-af0e8134605d None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:32.807955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fcc9-c1ec-46f5-891d-af0e8134605d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:32.808035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fcc9-c1ec-46f5-891d-af0e8134605d None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:32.809347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 509/1028] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:32.814676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c6e08-9ed5-47c9-a01d-5fa2ba732206 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:32.815105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c6e08-9ed5-47c9-a01d-5fa2ba732206 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:32.815240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c6e08-9ed5-47c9-a01d-5fa2ba732206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:32.832470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e43c6e08-9ed5-47c9-a01d-5fa2ba732206 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:32.833646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e43c6e08-9ed5-47c9-a01d-5fa2ba732206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:32.879717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:32.906142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 520/1029] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:32.928984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fcc9-c1ec-46f5-891d-af0e8134605d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:32.949199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:33.039823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fcc9-c1ec-46f5-891d-af0e8134605d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.076609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cdee5-16a8-4281-ab38-e6cadceaa36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.077486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdee5-16a8-4281-ab38-e6cadceaa36c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.077763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdee5-16a8-4281-ab38-e6cadceaa36c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.078030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdee5-16a8-4281-ab38-e6cadceaa36c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.088837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cdee5-16a8-4281-ab38-e6cadceaa36c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-148cdee5-16a8-4281-ab38-e6cadceaa36c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:33.097053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:33.098012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:33.099223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 510/1030] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jul 11 14:34:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:33.106145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c6e08-9ed5-47c9-a01d-5fa2ba732206 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:33.184315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d881ea-0559-47d1-95e0-93a60eb52059 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.184601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d881ea-0559-47d1-95e0-93a60eb52059 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.184885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d881ea-0559-47d1-95e0-93a60eb52059 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.186304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 511/1031] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:33.191353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142046ef-4ff7-47c4-beab-84973a8b8437 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.191644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142046ef-4ff7-47c4-beab-84973a8b8437 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.191926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142046ef-4ff7-47c4-beab-84973a8b8437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.207311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c6e08-9ed5-47c9-a01d-5fa2ba732206 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.209002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-142046ef-4ff7-47c4-beab-84973a8b8437 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:33.210224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-142046ef-4ff7-47c4-beab-84973a8b8437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:33.247375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.248072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.248357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.248634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.249373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:33.249679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:33.251064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:33.259261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 521/1032] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Jul 11 14:34:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:33.265042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:33.290679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 512/1033] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:33.309919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:33.314433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142046ef-4ff7-47c4-beab-84973a8b8437 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:33.326075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:33.373556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef17f4-dc99-4537-a577-5196645d0c71 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.410903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.411834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.412234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.412588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.423567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142046ef-4ff7-47c4-beab-84973a8b8437 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.424291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:33.425784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:33.443336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:33.444319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:33.445793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:33.445793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:33.445793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:33.445793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:33.445793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 522/1034] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:33.450683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:33.463273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebaef3-2d16-4cf3-9971-d693d0ee06c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.464276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebaef3-2d16-4cf3-9971-d693d0ee06c9 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.464668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebaef3-2d16-4cf3-9971-d693d0ee06c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.464953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebaef3-2d16-4cf3-9971-d693d0ee06c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.466129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebaef3-2d16-4cf3-9971-d693d0ee06c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:33.467566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebaef3-2d16-4cf3-9971-d693d0ee06c9 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:33.473553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 513/1035] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:33.474674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebaef3-2d16-4cf3-9971-d693d0ee06c9 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:33.556630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:33.559721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:33.567672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ec53d-d27b-48aa-8d35-1a4549234720 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.596010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebaef3-2d16-4cf3-9971-d693d0ee06c9 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.607096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.608410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.608902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.609197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.609939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:33.611391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:33.612714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:33.630639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 523/1036] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:33.631751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:33.643533 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb529eb-4e13-4987-8994-05d45a457454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.644211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb529eb-4e13-4987-8994-05d45a457454 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.644814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb529eb-4e13-4987-8994-05d45a457454 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.645096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb529eb-4e13-4987-8994-05d45a457454 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.645963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb529eb-4e13-4987-8994-05d45a457454 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:33.647448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb529eb-4e13-4987-8994-05d45a457454 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:33.733252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ea7a-5422-4519-8897-548849433e19 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.758193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 514/1037] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:34:33 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:34:33.774612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.775431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.775719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.776000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.784752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:33.786378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:33.802407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:33.803470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:33.805006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 524/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:34:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:33.810096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb529eb-4e13-4987-8994-05d45a457454 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:33.922517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb529eb-4e13-4987-8994-05d45a457454 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.955937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:33.961153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ba5d-b197-442c-b008-c28f4ae77342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.961829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ba5d-b197-442c-b008-c28f4ae77342 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.962136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ba5d-b197-442c-b008-c28f4ae77342 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.962423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ba5d-b197-442c-b008-c28f4ae77342 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.963268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ba5d-b197-442c-b008-c28f4ae77342 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:33.963580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ba5d-b197-442c-b008-c28f4ae77342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:33.965003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ba5d-b197-442c-b008-c28f4ae77342 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:33.984648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 515/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:34:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:33.991180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.008482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:34.014252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1bbc4-d573-409f-8770-1ab5856fee36 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.014547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1bbc4-d573-409f-8770-1ab5856fee36 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.014828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1bbc4-d573-409f-8770-1ab5856fee36 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.016490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 516/1040] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:34.021782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa92d-cca3-4c79-acea-c8edaeefdf3f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.022071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa92d-cca3-4c79-acea-c8edaeefdf3f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.022438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa92d-cca3-4c79-acea-c8edaeefdf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.039190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-28efa92d-cca3-4c79-acea-c8edaeefdf3f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:34.040380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-28efa92d-cca3-4c79-acea-c8edaeefdf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:34.104039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479413de-6e1a-4e7d-b2e2-6b7a7589e5e5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:34.113181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 517/1041] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:34.136527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efa92d-cca3-4c79-acea-c8edaeefdf3f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.140351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50f0ed-cc8f-4b2a-914a-3d018e025a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:34.141014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50f0ed-cc8f-4b2a-914a-3d018e025a94 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.141298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50f0ed-cc8f-4b2a-914a-3d018e025a94 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.141648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50f0ed-cc8f-4b2a-914a-3d018e025a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.213693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50f0ed-cc8f-4b2a-914a-3d018e025a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:34.215317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50f0ed-cc8f-4b2a-914a-3d018e025a94 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:34.227649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:34.253007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efa92d-cca3-4c79-acea-c8edaeefdf3f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:34.274378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:34.290501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:34.291415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.291697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.291973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] PATH_INFO: `/v3/services/image` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.292623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:34.294020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:34.307695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:34.308789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:34.315010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 518/1042] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Jul 11 14:34:34 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:34.315861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.328798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 525/1043] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:34:34.330021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50f0ed-cc8f-4b2a-914a-3d018e025a94 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.424078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d4900-8e71-49c0-ac4c-b0ed9a158c24 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:34.431516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50f0ed-cc8f-4b2a-914a-3d018e025a94 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:34.443234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:34.462804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:34.463734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.464022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.464302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.465054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] RBAC: Adding query filter params (name=image) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:34.465352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:34.466738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:34.467676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:34.468468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.468759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.469091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.473250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 519/1044] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:34.479875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.481217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:34.482699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:34.501126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:34.502132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:34.503205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:34.503205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:34.503205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:34.503205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:34.503205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 526/1045] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:34.507868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.539595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:34.595437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116c05b-f7e9-4e99-ad8d-e20dbc66270e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:34.621061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb8fc-79bb-49d4-83e6-5bd9512ca44f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:34.632638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:34.633445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.633734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.634013 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.634754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] RBAC: Adding query filter params (type=image) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:34.635064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:34.636531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:34.641777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 520/1046] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:34.647282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.660289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:34.660958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.661244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.661520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.662296 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:34.662607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:34.664515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:34.681671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 527/1047] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:34.682680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.707410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:34.765356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728857a-7b22-4bd2-8a2b-053029d52d04 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:34.781599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:34.795459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de338a9-475f-45c5-956d-620984ce91fa None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:34.803210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f9c73-3a10-4cee-9359-8b50ab3acfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:34.803881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9c73-3a10-4cee-9359-8b50ab3acfbc None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.804169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9c73-3a10-4cee-9359-8b50ab3acfbc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.804478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9c73-3a10-4cee-9359-8b50ab3acfbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.805215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f9c73-3a10-4cee-9359-8b50ab3acfbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:34.806658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f9c73-3a10-4cee-9359-8b50ab3acfbc None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:34.830569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:34.832501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:34.832501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:34.832501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:34.839592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:34.841022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:34.855239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:34.856447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:34.857609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 528/1048] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:34.862042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:34.901351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 521/1049] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:34:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:34:34.955403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:34.977497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1128-0cb0-4e77-b460-85378b4888af None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:35.021895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbf043-b5f6-40cb-9d1d-4a4763693f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:35.022634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbf043-b5f6-40cb-9d1d-4a4763693f18 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:35.022867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbf043-b5f6-40cb-9d1d-4a4763693f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:35.023202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbf043-b5f6-40cb-9d1d-4a4763693f18 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:35.024540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbf043-b5f6-40cb-9d1d-4a4763693f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:35.024856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbf043-b5f6-40cb-9d1d-4a4763693f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:35.026342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbf043-b5f6-40cb-9d1d-4a4763693f18 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:35.039336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 529/1050] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:35.045384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f9c73-3a10-4cee-9359-8b50ab3acfbc None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:35.154753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f9c73-3a10-4cee-9359-8b50ab3acfbc None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:35.187860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8029d-41bc-4f94-b9d4-437c2261e16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:35.188515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8029d-41bc-4f94-b9d4-437c2261e16f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:35.188792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8029d-41bc-4f94-b9d4-437c2261e16f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:35.189062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8029d-41bc-4f94-b9d4-437c2261e16f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:35.189887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8029d-41bc-4f94-b9d4-437c2261e16f None admin] RBAC: Adding query filter params (role.id=5d9ce550cedd4f21b5241d4a8f0c5f89, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=035eeee0a72449358827a34bb09aa057) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:35.190221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8029d-41bc-4f94-b9d4-437c2261e16f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:35.191637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8029d-41bc-4f94-b9d4-437c2261e16f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:35.197808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 522/1051] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:35 2022] GET /identity/v3/role_assignments?user.id=035eeee0a72449358827a34bb09aa057&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=5d9ce550cedd4f21b5241d4a8f0c5f89 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:35.874609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4f86-440b-4dbf-b7b4-b8626824ad39 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:35.874932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4f86-440b-4dbf-b7b4-b8626824ad39 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:35.875181 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4f86-440b-4dbf-b7b4-b8626824ad39 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:35.876708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 530/1052] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:35.881724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ffd9-d811-4ef5-b154-dd53fbbec477 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:35.882025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ffd9-d811-4ef5-b154-dd53fbbec477 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:35.882338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ffd9-d811-4ef5-b154-dd53fbbec477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:35.900599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-05e6ffd9-d811-4ef5-b154-dd53fbbec477 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:35.901798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-05e6ffd9-d811-4ef5-b154-dd53fbbec477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:35.928011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:35.971379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 523/1053] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:35.994361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d4f86-440b-4dbf-b7b4-b8626824ad39 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:36.101064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d4f86-440b-4dbf-b7b4-b8626824ad39 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:36.138678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14304-87cb-471c-8288-6a7109c71da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:36.139491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14304-87cb-471c-8288-6a7109c71da0 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:36.139778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14304-87cb-471c-8288-6a7109c71da0 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:36.140060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14304-87cb-471c-8288-6a7109c71da0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:36.151522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:36.156329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b14304-87cb-471c-8288-6a7109c71da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-d8b14304-87cb-471c-8288-6a7109c71da0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:36.164036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:36.168964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:36.169863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 531/1054] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:36.172442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6ffd9-d811-4ef5-b154-dd53fbbec477 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:36.280365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6ffd9-d811-4ef5-b154-dd53fbbec477 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:36.315173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:36.315839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:36.316121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:36.316393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:36.317133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:36.317438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:36.318823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:36.332143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 524/1055] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:36.333401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14304-87cb-471c-8288-6a7109c71da0 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:36.441084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14304-87cb-471c-8288-6a7109c71da0 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:36.474835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b85da5-b404-4b0e-973c-a0bc568d8352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:36.475693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b85da5-b404-4b0e-973c-a0bc568d8352 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:36.476105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b85da5-b404-4b0e-973c-a0bc568d8352 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:36.476777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b85da5-b404-4b0e-973c-a0bc568d8352 None admin] PATH_INFO: `/v3/users/dd5bf017b48e43d59b068dfd892146a9` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:36.490042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b85da5-b404-4b0e-973c-a0bc568d8352 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5bf017b48e43d59b068dfd892146a9)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:36.491499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b85da5-b404-4b0e-973c-a0bc568d8352 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:36.493922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 532/1056] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:36 2022] GET /identity/v3/users/dd5bf017b48e43d59b068dfd892146a9 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:36.499443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:36.526673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:36.604885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc1002-b7e9-481b-8d2e-a595592cb6d5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:36.641142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0646e8-ba12-4119-9d74-719b4f410ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:36.641798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0646e8-ba12-4119-9d74-719b4f410ba9 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:36.642083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0646e8-ba12-4119-9d74-719b4f410ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:36.642390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0646e8-ba12-4119-9d74-719b4f410ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:36.719340 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0646e8-ba12-4119-9d74-719b4f410ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:36.720790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0646e8-ba12-4119-9d74-719b4f410ba9 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:36.758066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:36.843694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 525/1057] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:34:36.849493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b85da5-b404-4b0e-973c-a0bc568d8352 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:36.911698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:36.957618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b85da5-b404-4b0e-973c-a0bc568d8352 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:36.993717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbd7a5-ec86-404d-bd4a-199e93ca0fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:36.994527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbd7a5-ec86-404d-bd4a-199e93ca0fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:36.994818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbd7a5-ec86-404d-bd4a-199e93ca0fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:36.995100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbd7a5-ec86-404d-bd4a-199e93ca0fb3 None admin] PATH_INFO: `/v3/projects/c0958590f98048beb2af925c61e7ae33` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:36.996284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbd7a5-ec86-404d-bd4a-199e93ca0fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=c0958590f98048beb2af925c61e7ae33)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:36.997767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbd7a5-ec86-404d-bd4a-199e93ca0fb3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:36.999975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 533/1058] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:34:36 2022] GET /identity/v3/projects/c0958590f98048beb2af925c61e7ae33 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:37.003963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633498aa-3f14-47a1-b4f1-56023146cd01 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.004420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633498aa-3f14-47a1-b4f1-56023146cd01 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.004596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633498aa-3f14-47a1-b4f1-56023146cd01 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.005687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbd7a5-ec86-404d-bd4a-199e93ca0fb3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:37.006055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 526/1059] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:37.010790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cafd9e-4d61-4dc1-b97c-3c6f830fce16 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.011089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cafd9e-4d61-4dc1-b97c-3c6f830fce16 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.011372 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cafd9e-4d61-4dc1-b97c-3c6f830fce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.031293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-97cafd9e-4d61-4dc1-b97c-3c6f830fce16 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:37.032486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-97cafd9e-4d61-4dc1-b97c-3c6f830fce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:37.110017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 527/1060] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:37.131441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbd7a5-ec86-404d-bd4a-199e93ca0fb3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:37.132425 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cafd9e-4d61-4dc1-b97c-3c6f830fce16 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:37.158552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:37.169906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee3d18-8068-4c15-8eba-4c69b31ab075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:37.170633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee3d18-8068-4c15-8eba-4c69b31ab075 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.170923 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee3d18-8068-4c15-8eba-4c69b31ab075 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.171211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee3d18-8068-4c15-8eba-4c69b31ab075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.172081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee3d18-8068-4c15-8eba-4c69b31ab075 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=c0958590f98048beb2af925c61e7ae33, user.id=dd5bf017b48e43d59b068dfd892146a9) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:37.172426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee3d18-8068-4c15-8eba-4c69b31ab075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:37.173866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee3d18-8068-4c15-8eba-4c69b31ab075 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:37.179770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 534/1061] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:37 2022] GET /identity/v3/role_assignments?user.id=dd5bf017b48e43d59b068dfd892146a9&scope.project.id=c0958590f98048beb2af925c61e7ae33&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:37.196772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:37.205633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ced6e-1f33-4e0f-9870-5529bcdf22b5 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.205916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ced6e-1f33-4e0f-9870-5529bcdf22b5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.206246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ced6e-1f33-4e0f-9870-5529bcdf22b5 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.212764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 535/1062] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:37.214885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a30c-962f-4e9f-9fc2-099ce5d7b9ff None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.215182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a30c-962f-4e9f-9fc2-099ce5d7b9ff None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.215464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a30c-962f-4e9f-9fc2-099ce5d7b9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.234194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b0d4a30c-962f-4e9f-9fc2-099ce5d7b9ff None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:37.235528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b0d4a30c-962f-4e9f-9fc2-099ce5d7b9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:37.249680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cafd9e-4d61-4dc1-b97c-3c6f830fce16 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:37.288958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7497a-810e-4cfc-9535-8744c52697b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:37.289625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7497a-810e-4cfc-9535-8744c52697b0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.290041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7497a-810e-4cfc-9535-8744c52697b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.290354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7497a-810e-4cfc-9535-8744c52697b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.321247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 536/1063] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:37.344860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4a30c-962f-4e9f-9fc2-099ce5d7b9ff None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:37.369847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7497a-810e-4cfc-9535-8744c52697b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:37.371386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7497a-810e-4cfc-9535-8744c52697b0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:37.435607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:37.451414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4a30c-962f-4e9f-9fc2-099ce5d7b9ff None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:37.471253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:37.485897 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 528/1064] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:34:37.491080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83b24-3f2a-4f23-b8bb-2f5f66cea111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:37.491701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7497a-810e-4cfc-9535-8744c52697b0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:37.493046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83b24-3f2a-4f23-b8bb-2f5f66cea111 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.493534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83b24-3f2a-4f23-b8bb-2f5f66cea111 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.494016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83b24-3f2a-4f23-b8bb-2f5f66cea111 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.505517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf83b24-3f2a-4f23-b8bb-2f5f66cea111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-6cf83b24-3f2a-4f23-b8bb-2f5f66cea111 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:37.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:37.515927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:37.516931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:37.525992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 537/1065] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jul 11 14:34:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:37.527984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83b24-3f2a-4f23-b8bb-2f5f66cea111 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:37.611218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7497a-810e-4cfc-9535-8744c52697b0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:37.650892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:37.651718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.651988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.652263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.654503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83b24-3f2a-4f23-b8bb-2f5f66cea111 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:37.662687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:37.664162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:37.683106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:37.684094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:37.685337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:37.685337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:37.685337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:37.685337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:37.685337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 529/1066] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:37.690095 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:37.692991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:37.693843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.694149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.694430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.695806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:37.696113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:37.697474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:37.699626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:37.711537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 538/1067] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Jul 11 14:34:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:37.718047 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:37.763203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:37.809265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6b3d9-bfd4-4838-ac3b-1ca435d8bbcf None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:37.826946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a494-d210-4536-afed-f0e89f18b590 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:37.845754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:37.846270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.846558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.846835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.847568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:37.847868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:37.849247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:37.862179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 530/1068] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:37.870036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:37.871267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:37.871738 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:37.872184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:37.885676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:37.887565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:37.912130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:37.913169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:37.919271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:37.919271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:37.919271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:37.919271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:37.919271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 539/1069] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:37.921973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:37.994949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:38.032001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33be10-fa38-4806-a5f0-cbdf22f64699 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:38.069263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:38.069949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:38.070308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:38.070594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:38.072354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:38.072354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:38.072992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:38.087451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 531/1070] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:38.093388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:38.190152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:38.198430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41b840-0e16-4ea2-b532-0eb3cb5c7209 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:38.231921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:38.232712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:38.232998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:38.233276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:38.240778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:38.242298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:38.255917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:38.257097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:38.258609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 540/1071] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:34:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:38.262841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:38.363904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8bf6a-ae9d-43ce-85ae-85ef08ae217e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:38.388629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:38.397257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:38.397921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:38.398740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:38.399019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:38.399847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:38.400157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:38.401575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:38.419409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 532/1072] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:34:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:38.425006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:38.524878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37bf17-3772-4cf1-89c3-af5cdb867007 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:38.559271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:38.560067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:38.560354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:38.560634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:38.571854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:38.573297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:38.590663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:38.591745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:38.592691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:38.592691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:38.592691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:38.592691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:38.592691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 541/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:38.597472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:38.696167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3552fb-bbca-4afb-bda8-a245d2ce4c47 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:38.729381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:38.730043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:38.730359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:38.730642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:38.731363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:38.731672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:38.733043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:38.749874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 533/1074] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:38.751159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:38.755011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:38.852148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ae58-93f2-4a44-9fc8-8d89c92d3a37 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:38.885657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:38.886546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:38.886835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:38.887117 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:38.894081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:38.895546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:38.910240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:38.911312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:38.912259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 542/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:38.917533 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:38.966601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:39.024917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351093f-9884-4204-8b77-2b499f00d9d3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:39.058023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47de6-3830-4481-b6f0-ffdb55baa445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:39.058722 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47de6-3830-4481-b6f0-ffdb55baa445 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.059000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47de6-3830-4481-b6f0-ffdb55baa445 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.060097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47de6-3830-4481-b6f0-ffdb55baa445 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.060097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f47de6-3830-4481-b6f0-ffdb55baa445 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:39.060344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f47de6-3830-4481-b6f0-ffdb55baa445 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:39.061772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f47de6-3830-4481-b6f0-ffdb55baa445 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:39.074680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 534/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:39.080741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:39.143738 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:39.181610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecff84e-a760-4b66-88fb-3fae8e2f8abe None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:39.215489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e5e0f-556a-4466-9807-869e1f7c4c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:39.216374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5e0f-556a-4466-9807-869e1f7c4c03 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.216709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5e0f-556a-4466-9807-869e1f7c4c03 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.216984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5e0f-556a-4466-9807-869e1f7c4c03 None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/035eeee0a72449358827a34bb09aa057/roles/5d9ce550cedd4f21b5241d4a8f0c5f89` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.219264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e5e0f-556a-4466-9807-869e1f7c4c03 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=035eeee0a72449358827a34bb09aa057, role_id=5d9ce550cedd4f21b5241d4a8f0c5f89)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:39.220700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e5e0f-556a-4466-9807-869e1f7c4c03 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:39.228368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164301cc-85c9-4e4e-a2fa-6f6207a299ee None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.228663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164301cc-85c9-4e4e-a2fa-6f6207a299ee None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.228944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164301cc-85c9-4e4e-a2fa-6f6207a299ee None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.230356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 535/1077] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:39.235126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2968c90-3484-4f90-969d-aefb6fabd9ef None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.240011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2968c90-3484-4f90-969d-aefb6fabd9ef None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.240011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2968c90-3484-4f90-969d-aefb6fabd9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.252607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c2968c90-3484-4f90-969d-aefb6fabd9ef None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:39.253786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c2968c90-3484-4f90-969d-aefb6fabd9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:39.306729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 543/1078] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:34:39 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/035eeee0a72449358827a34bb09aa057/roles/5d9ce550cedd4f21b5241d4a8f0c5f89 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:34:39.324719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 536/1079] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:39.348192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e5e0f-556a-4466-9807-869e1f7c4c03 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:39.459025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e5e0f-556a-4466-9807-869e1f7c4c03 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:39.484869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:39.495829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4660ff6-66ed-4692-8a42-2dcaf1006b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:39.498284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4660ff6-66ed-4692-8a42-2dcaf1006b4c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.498284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4660ff6-66ed-4692-8a42-2dcaf1006b4c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.498284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4660ff6-66ed-4692-8a42-2dcaf1006b4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.507230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4660ff6-66ed-4692-8a42-2dcaf1006b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e4660ff6-66ed-4692-8a42-2dcaf1006b4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:39.515095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:39.516202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:39.517102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 544/1080] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:34:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:39.522341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2968c90-3484-4f90-969d-aefb6fabd9ef None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:39.558370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:39.624110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2968c90-3484-4f90-969d-aefb6fabd9ef None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:39.659041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:39.659713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.659996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.660275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.661023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:39.661330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:39.662733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:39.671745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 537/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:34:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:39.677401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4660ff6-66ed-4692-8a42-2dcaf1006b4c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:39.778644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4660ff6-66ed-4692-8a42-2dcaf1006b4c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:39.813069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc106-e653-49f2-b0ec-06eb07059d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:39.813936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc106-e653-49f2-b0ec-06eb07059d93 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.814266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc106-e653-49f2-b0ec-06eb07059d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.814550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc106-e653-49f2-b0ec-06eb07059d93 None admin] PATH_INFO: `/v3/users/dd5bf017b48e43d59b068dfd892146a9` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.815753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacc106-e653-49f2-b0ec-06eb07059d93 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5bf017b48e43d59b068dfd892146a9)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:39.817186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacc106-e653-49f2-b0ec-06eb07059d93 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:39.818868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 545/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:39 2022] GET /identity/v3/users/dd5bf017b48e43d59b068dfd892146a9 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:39.824637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:39.924210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:39.930169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88ba71-258a-459a-a90c-f0138726b182 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:39.964490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75a1c6-7587-4862-bafa-fed6c8889c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:39.965347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a1c6-7587-4862-bafa-fed6c8889c15 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.965634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a1c6-7587-4862-bafa-fed6c8889c15 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.965907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a1c6-7587-4862-bafa-fed6c8889c15 None admin] PATH_INFO: `/v3/projects/c0958590f98048beb2af925c61e7ae33` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.967200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a1c6-7587-4862-bafa-fed6c8889c15 None admin] RBAC: Authorizing `identity:get_project(project_id=c0958590f98048beb2af925c61e7ae33)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:39.968546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a1c6-7587-4862-bafa-fed6c8889c15 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:39.970276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 538/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:34:39 2022] GET /identity/v3/projects/c0958590f98048beb2af925c61e7ae33 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:39.977674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc106-e653-49f2-b0ec-06eb07059d93 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:40.031186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:40.080836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc106-e653-49f2-b0ec-06eb07059d93 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:40.114008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcc668-28d2-47cf-9c56-76aba8114ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:40.114919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcc668-28d2-47cf-9c56-76aba8114ce7 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:40.115206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcc668-28d2-47cf-9c56-76aba8114ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:40.115488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcc668-28d2-47cf-9c56-76aba8114ce7 None admin] PATH_INFO: `/v3/projects/c0958590f98048beb2af925c61e7ae33/users/dd5bf017b48e43d59b068dfd892146a9/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:40.117502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcc668-28d2-47cf-9c56-76aba8114ce7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0958590f98048beb2af925c61e7ae33, user_id=dd5bf017b48e43d59b068dfd892146a9, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:40.118956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcc668-28d2-47cf-9c56-76aba8114ce7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:40.191644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 546/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:34:39 2022] PUT /identity/v3/projects/c0958590f98048beb2af925c61e7ae33/users/dd5bf017b48e43d59b068dfd892146a9/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:34:41.340163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ae15-55f1-4ce8-b85e-afc41417a6f9 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:41.340731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ae15-55f1-4ce8-b85e-afc41417a6f9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:41.340731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ae15-55f1-4ce8-b85e-afc41417a6f9 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:41.342069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 539/1085] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:41.347398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb7d6-8492-4597-befe-879083d6ebcd None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:41.347792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb7d6-8492-4597-befe-879083d6ebcd None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:41.348066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb7d6-8492-4597-befe-879083d6ebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:41.364456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1aceb7d6-8492-4597-befe-879083d6ebcd None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:41.365624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1aceb7d6-8492-4597-befe-879083d6ebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:41.431392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 547/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:41.455297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965ae15-55f1-4ce8-b85e-afc41417a6f9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:41.554230 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965ae15-55f1-4ce8-b85e-afc41417a6f9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:41.588448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb15d5-748e-421a-9d64-7110534104eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:41.589262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb15d5-748e-421a-9d64-7110534104eb None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:41.589533 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb15d5-748e-421a-9d64-7110534104eb None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:41.589806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb15d5-748e-421a-9d64-7110534104eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:41.600362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb15d5-748e-421a-9d64-7110534104eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-d3bb15d5-748e-421a-9d64-7110534104eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:41.609010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:41.611022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 540/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jul 11 14:34:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:41.616340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceb7d6-8492-4597-befe-879083d6ebcd None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:41.659492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:41.717291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceb7d6-8492-4597-befe-879083d6ebcd None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:41.755379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:41.756055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:41.756338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:41.756612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:41.757361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:41.757702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:41.759099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:41.769637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 548/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Jul 11 14:34:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:41.775417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb15d5-748e-421a-9d64-7110534104eb None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:41.803651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:41.881898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb15d5-748e-421a-9d64-7110534104eb None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:41.917098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:41.917890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:41.918202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:41.918478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:41.928858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:41.930926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:41.948352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:41.949281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:41.950249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:41.950249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:41.950249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:41.950249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:41.950249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 541/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:34:41.955388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.053422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2724f-3bac-4010-8bc8-97f2341851ea None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.056344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:42.087178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142575-722a-41cc-a819-e66bdb22015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.087851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142575-722a-41cc-a819-e66bdb22015e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.088327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142575-722a-41cc-a819-e66bdb22015e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.088768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142575-722a-41cc-a819-e66bdb22015e None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.089787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142575-722a-41cc-a819-e66bdb22015e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:42.090092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142575-722a-41cc-a819-e66bdb22015e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:42.091479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142575-722a-41cc-a819-e66bdb22015e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:42.103597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 549/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:42.109328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.186829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:42.205691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9dc97-416c-4276-8a91-27efc05543f2 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.205981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9dc97-416c-4276-8a91-27efc05543f2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.211218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9dc97-416c-4276-8a91-27efc05543f2 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.211218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 550/1091] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:42.211396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410b4d-88cd-4901-a4a5-7e143a34ddd8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.213068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca57d-5c48-4a9a-b9f3-603f8ec6612e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.213362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca57d-5c48-4a9a-b9f3-603f8ec6612e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.213647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca57d-5c48-4a9a-b9f3-603f8ec6612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.230799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-2e0ca57d-5c48-4a9a-b9f3-603f8ec6612e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:42.231998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2e0ca57d-5c48-4a9a-b9f3-603f8ec6612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:42.243484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.244266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.244545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.244814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.251909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:42.253337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:34:42.268587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:42.269896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:34:42.271201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:42.274709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 542/1092] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:42.276421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.300032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 551/1093] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:42.323979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca57d-5c48-4a9a-b9f3-603f8ec6612e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.377238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ff565-6b12-45dc-b21e-463207324a25 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.412267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.412933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.413216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.413489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.414387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:42.414701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:42.416124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:42.416564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:42.419249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:42.423061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca57d-5c48-4a9a-b9f3-603f8ec6612e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.433058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 543/1094] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:42.438909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.459929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740dc1-f8f4-460f-8589-cc204d3fc129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.461391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740dc1-f8f4-460f-8589-cc204d3fc129 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.461676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740dc1-f8f4-460f-8589-cc204d3fc129 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.461950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740dc1-f8f4-460f-8589-cc204d3fc129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.472400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66740dc1-f8f4-460f-8589-cc204d3fc129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-66740dc1-f8f4-460f-8589-cc204d3fc129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:34:42.480045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:42.481233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:34:42.482385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 552/1095] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:42.487028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740dc1-f8f4-460f-8589-cc204d3fc129 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.557624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563aa1b-96d7-4ada-a25a-cacd10b41d21 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.588088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740dc1-f8f4-460f-8589-cc204d3fc129 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.592404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242862a8-31a0-4a2f-b5ef-207d1acce2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.592723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242862a8-31a0-4a2f-b5ef-207d1acce2e6 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.593009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242862a8-31a0-4a2f-b5ef-207d1acce2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.593288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242862a8-31a0-4a2f-b5ef-207d1acce2e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.626354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.627024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.627314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.627589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.628344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:42.628653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:42.630017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:42.639380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 553/1096] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:42.644607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.660196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:42.663073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:42.667512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242862a8-31a0-4a2f-b5ef-207d1acce2e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:42.668963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242862a8-31a0-4a2f-b5ef-207d1acce2e6 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:42.745654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ae95-ca42-4a98-b26e-81d59f8cf33d None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.768844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 544/1097] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:34:42.774671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242862a8-31a0-4a2f-b5ef-207d1acce2e6 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.779672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b513316-ecb3-4991-b781-f36bdaae303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.780541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b513316-ecb3-4991-b781-f36bdaae303f None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.780828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b513316-ecb3-4991-b781-f36bdaae303f None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.781114 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b513316-ecb3-4991-b781-f36bdaae303f None admin] PATH_INFO: `/v3/users/dd5bf017b48e43d59b068dfd892146a9` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.782346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b513316-ecb3-4991-b781-f36bdaae303f None admin] RBAC: Authorizing `identity:get_user(user_id=dd5bf017b48e43d59b068dfd892146a9)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:42.783782 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b513316-ecb3-4991-b781-f36bdaae303f None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:42.789888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 554/1098] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/users/dd5bf017b48e43d59b068dfd892146a9 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:42.790848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b513316-ecb3-4991-b781-f36bdaae303f None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.863827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:42.870860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242862a8-31a0-4a2f-b5ef-207d1acce2e6 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.874159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:42.890318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b513316-ecb3-4991-b781-f36bdaae303f None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:42.904497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.907845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.907845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.907845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.915740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:42.917165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:42.923031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034ecd1-c60d-4bc3-bc2e-b3589abc89bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:42.923672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034ecd1-c60d-4bc3-bc2e-b3589abc89bb None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:42.923964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034ecd1-c60d-4bc3-bc2e-b3589abc89bb None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:42.924240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034ecd1-c60d-4bc3-bc2e-b3589abc89bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:34:42.935176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:42.936217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:42.937368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:34:42.937368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:34:42.937368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:34:42.937368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:42.937368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 545/1099] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:42.942294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:42.993601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034ecd1-c60d-4bc3-bc2e-b3589abc89bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:42.995060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034ecd1-c60d-4bc3-bc2e-b3589abc89bb None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:43.041679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c636315-a0ce-413b-a1e9-7cf2e099372c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:43.075704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:43.076378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:43.076635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:43.076744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:43.076905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:43.077632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:43.077936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:43.079348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:43.090594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 546/1100] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:43.098195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 555/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:34:43.098334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:43.099272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034ecd1-c60d-4bc3-bc2e-b3589abc89bb None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:43.105963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:43.196357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93105b-5caf-4fec-a6fc-fcbc8c1419a5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:43.197681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034ecd1-c60d-4bc3-bc2e-b3589abc89bb None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:43.230296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:43.230742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f1ed-bceb-416d-a578-e715a700956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:43.231111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:43.231397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:43.231593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f1ed-bceb-416d-a578-e715a700956e None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:43.231698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:43.231880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f1ed-bceb-416d-a578-e715a700956e None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:43.232158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f1ed-bceb-416d-a578-e715a700956e None admin] PATH_INFO: `/v3/projects/c0958590f98048beb2af925c61e7ae33` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:43.233347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f1ed-bceb-416d-a578-e715a700956e None admin] RBAC: Authorizing `identity:get_project(project_id=c0958590f98048beb2af925c61e7ae33)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:43.234803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f1ed-bceb-416d-a578-e715a700956e None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:43.236504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 556/1102] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:34:43 2022] GET /identity/v3/projects/c0958590f98048beb2af925c61e7ae33 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:43.238545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:43.239968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:43.243091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f1ed-bceb-416d-a578-e715a700956e None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:34:43.255175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:34:43.256321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:34:43.257661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 547/1103] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:34:43.261890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:43.298723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:43.327213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:43.344254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f1ed-bceb-416d-a578-e715a700956e None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:43.361685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d6f06-c45c-4e4c-b0ea-6ae1338706c3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:43.378511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:43.379158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:43.379438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:43.379715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:43.380539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=c0958590f98048beb2af925c61e7ae33, user.id=dd5bf017b48e43d59b068dfd892146a9) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:43.380847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:43.382289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:43.402132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 557/1104] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:43 2022] GET /identity/v3/role_assignments?user.id=dd5bf017b48e43d59b068dfd892146a9&scope.project.id=c0958590f98048beb2af925c61e7ae33&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:43.402347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76c43f-93bf-4b50-92b8-e5d2e435faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:43.402347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c43f-93bf-4b50-92b8-e5d2e435faa6 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:43.402347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c43f-93bf-4b50-92b8-e5d2e435faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:43.402347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c43f-93bf-4b50-92b8-e5d2e435faa6 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:43.403045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76c43f-93bf-4b50-92b8-e5d2e435faa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:43.403045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76c43f-93bf-4b50-92b8-e5d2e435faa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:43.403045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76c43f-93bf-4b50-92b8-e5d2e435faa6 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:43.416358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 548/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:34:43.422613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:43.529132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0b7f7-1148-414b-9d6c-6b2ab32d48da None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:43.547642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:43.565680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d421cd4-1229-47cf-8afc-44b6c365d0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:43.565930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d421cd4-1229-47cf-8afc-44b6c365d0a5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:43.566242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d421cd4-1229-47cf-8afc-44b6c365d0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:43.566517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d421cd4-1229-47cf-8afc-44b6c365d0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:43.567377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d421cd4-1229-47cf-8afc-44b6c365d0a5 None admin] RBAC: Adding query filter params (role.id=5d9ce550cedd4f21b5241d4a8f0c5f89, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=035eeee0a72449358827a34bb09aa057) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:43.567683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d421cd4-1229-47cf-8afc-44b6c365d0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:43.569098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d421cd4-1229-47cf-8afc-44b6c365d0a5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:43.575432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 558/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:43 2022] GET /identity/v3/role_assignments?user.id=035eeee0a72449358827a34bb09aa057&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=5d9ce550cedd4f21b5241d4a8f0c5f89 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:45.478284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb8d8-1fc8-4f80-b65b-02d76e5f363b None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:45.478836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb8d8-1fc8-4f80-b65b-02d76e5f363b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:45.478836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb8d8-1fc8-4f80-b65b-02d76e5f363b None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:45.480188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 549/1107] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:45.485310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557e4a-4c8d-4697-9bbe-f4262e2c5266 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:45.485712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557e4a-4c8d-4697-9bbe-f4262e2c5266 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:45.485875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557e4a-4c8d-4697-9bbe-f4262e2c5266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:45.503065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-22557e4a-4c8d-4697-9bbe-f4262e2c5266 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:45.504253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-22557e4a-4c8d-4697-9bbe-f4262e2c5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:45.569287 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 559/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:45.593676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbb8d8-1fc8-4f80-b65b-02d76e5f363b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:45.693453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbb8d8-1fc8-4f80-b65b-02d76e5f363b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:45.718024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:45.726012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52b7e8-1be1-4202-a271-e009a87df6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:45.726851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52b7e8-1be1-4202-a271-e009a87df6c8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:45.727144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52b7e8-1be1-4202-a271-e009a87df6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:45.729941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52b7e8-1be1-4202-a271-e009a87df6c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:45.729941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52b7e8-1be1-4202-a271-e009a87df6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:45.730135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52b7e8-1be1-4202-a271-e009a87df6c8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:45.731646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 550/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:45.737352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22557e4a-4c8d-4697-9bbe-f4262e2c5266 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:45.835006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22557e4a-4c8d-4697-9bbe-f4262e2c5266 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:45.845398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:45.869165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca5dd-7cad-4345-ac2e-a6c38972aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:45.869877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca5dd-7cad-4345-ac2e-a6c38972aebf None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:45.870200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca5dd-7cad-4345-ac2e-a6c38972aebf None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:45.870697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca5dd-7cad-4345-ac2e-a6c38972aebf None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:45.871634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca5dd-7cad-4345-ac2e-a6c38972aebf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:45.873484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca5dd-7cad-4345-ac2e-a6c38972aebf None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:45.951584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 560/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:34:45 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:48.009938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3582a3-d212-4a23-a4f3-527821c806db None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:48.010525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3582a3-d212-4a23-a4f3-527821c806db None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:48.010525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3582a3-d212-4a23-a4f3-527821c806db None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:48.011927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 551/1111] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:48.017844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deee3c3-4bdd-4f9d-9aae-6f0bbc6fe217 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:48.018276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deee3c3-4bdd-4f9d-9aae-6f0bbc6fe217 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:48.018451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deee3c3-4bdd-4f9d-9aae-6f0bbc6fe217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:48.035386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6deee3c3-4bdd-4f9d-9aae-6f0bbc6fe217 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:48.036576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6deee3c3-4bdd-4f9d-9aae-6f0bbc6fe217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:48.102474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 561/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:48.125787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3582a3-d212-4a23-a4f3-527821c806db None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:48.228504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3582a3-d212-4a23-a4f3-527821c806db None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:48.263836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f4843-5f7c-4b77-b58e-8e46abb93e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:48.264610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f4843-5f7c-4b77-b58e-8e46abb93e96 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:48.264896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f4843-5f7c-4b77-b58e-8e46abb93e96 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:48.265176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f4843-5f7c-4b77-b58e-8e46abb93e96 None admin] PATH_INFO: `/v3/roles/0053c5c9a9f74809be6ecfcdeb35c100` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:48.266692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f4843-5f7c-4b77-b58e-8e46abb93e96 None admin] RBAC: Authorizing `identity:get_role(role_id=0053c5c9a9f74809be6ecfcdeb35c100)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:48.268054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f4843-5f7c-4b77-b58e-8e46abb93e96 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:48.269412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 552/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:48 2022] GET /identity/v3/roles/0053c5c9a9f74809be6ecfcdeb35c100 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:48.275756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deee3c3-4bdd-4f9d-9aae-6f0bbc6fe217 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:48.367985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:48.373582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deee3c3-4bdd-4f9d-9aae-6f0bbc6fe217 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:48.406513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d90a7-9ba4-481d-b086-2b68c3219496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:48.407364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d90a7-9ba4-481d-b086-2b68c3219496 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:48.407647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d90a7-9ba4-481d-b086-2b68c3219496 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:48.407924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d90a7-9ba4-481d-b086-2b68c3219496 None admin] PATH_INFO: `/v3/users/75d244813df045509331a20d8ade3816` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:48.422091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d90a7-9ba4-481d-b086-2b68c3219496 None admin] RBAC: Authorizing `identity:get_user(user_id=75d244813df045509331a20d8ade3816)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:48.423547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d90a7-9ba4-481d-b086-2b68c3219496 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:48.425463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 562/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:48 2022] GET /identity/v3/users/75d244813df045509331a20d8ade3816 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:48.431585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f4843-5f7c-4b77-b58e-8e46abb93e96 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:48.493584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:48.531982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f4843-5f7c-4b77-b58e-8e46abb93e96 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:48.573000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85ef5-cead-4586-92e2-e8266f6075c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:48.573661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85ef5-cead-4586-92e2-e8266f6075c1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:48.573944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85ef5-cead-4586-92e2-e8266f6075c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:48.574254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85ef5-cead-4586-92e2-e8266f6075c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:48.654153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85ef5-cead-4586-92e2-e8266f6075c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:48.655604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85ef5-cead-4586-92e2-e8266f6075c1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:48.724751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:48.778008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 553/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:34:48.784191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d90a7-9ba4-481d-b086-2b68c3219496 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:48.927355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d90a7-9ba4-481d-b086-2b68c3219496 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:48.959845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143361a-b344-4681-b3e9-637ac9842b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:48.961302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143361a-b344-4681-b3e9-637ac9842b24 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:48.961586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143361a-b344-4681-b3e9-637ac9842b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:48.961864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143361a-b344-4681-b3e9-637ac9842b24 None admin] PATH_INFO: `/v3/projects/c0958590f98048beb2af925c61e7ae33` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:48.963068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143361a-b344-4681-b3e9-637ac9842b24 None admin] RBAC: Authorizing `identity:get_project(project_id=c0958590f98048beb2af925c61e7ae33)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:48.964491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143361a-b344-4681-b3e9-637ac9842b24 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:48.966215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 563/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:34:48 2022] GET /identity/v3/projects/c0958590f98048beb2af925c61e7ae33 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:48.972500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85ef5-cead-4586-92e2-e8266f6075c1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:49.069197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85ef5-cead-4586-92e2-e8266f6075c1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:49.102762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c587c8-3776-4111-9bde-90211c891af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:49.103408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c587c8-3776-4111-9bde-90211c891af8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:49.103689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c587c8-3776-4111-9bde-90211c891af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:49.103966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c587c8-3776-4111-9bde-90211c891af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:49.104779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c587c8-3776-4111-9bde-90211c891af8 None admin] RBAC: Adding query filter params (role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=c0958590f98048beb2af925c61e7ae33, user.id=75d244813df045509331a20d8ade3816) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:49.105093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c587c8-3776-4111-9bde-90211c891af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:49.106545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c587c8-3776-4111-9bde-90211c891af8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:49.111786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 554/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:48 2022] GET /identity/v3/role_assignments?user.id=75d244813df045509331a20d8ade3816&scope.project.id=c0958590f98048beb2af925c61e7ae33&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:51.077204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e352d1-25c1-4366-bc19-91559a0a1f93 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:51.077703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e352d1-25c1-4366-bc19-91559a0a1f93 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:51.077703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e352d1-25c1-4366-bc19-91559a0a1f93 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:51.079082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 564/1118] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:51.084313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c87ee-d762-4cf1-9469-23b9dca41b3d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:51.084719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c87ee-d762-4cf1-9469-23b9dca41b3d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:51.084869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c87ee-d762-4cf1-9469-23b9dca41b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:51.102180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-6e9c87ee-d762-4cf1-9469-23b9dca41b3d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:51.103381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6e9c87ee-d762-4cf1-9469-23b9dca41b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:51.122625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:51.168363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 555/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:51.190682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e352d1-25c1-4366-bc19-91559a0a1f93 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:51.215662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:51.295087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e352d1-25c1-4366-bc19-91559a0a1f93 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:51.327396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37863a-ee26-4a93-9b0f-b810dd9ed321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:51.328172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37863a-ee26-4a93-9b0f-b810dd9ed321 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:51.328453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37863a-ee26-4a93-9b0f-b810dd9ed321 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:51.328728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37863a-ee26-4a93-9b0f-b810dd9ed321 None admin] PATH_INFO: `/v3/roles/0053c5c9a9f74809be6ecfcdeb35c100` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:51.330206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37863a-ee26-4a93-9b0f-b810dd9ed321 None admin] RBAC: Authorizing `identity:get_role(role_id=0053c5c9a9f74809be6ecfcdeb35c100)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:51.331558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37863a-ee26-4a93-9b0f-b810dd9ed321 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:51.332915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 565/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:51 2022] GET /identity/v3/roles/0053c5c9a9f74809be6ecfcdeb35c100 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:51.339360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c87ee-d762-4cf1-9469-23b9dca41b3d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:51.435079 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c87ee-d762-4cf1-9469-23b9dca41b3d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:51.468604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c5b5f-bd01-47a4-a9e6-b9c4edd0541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:51.469458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c5b5f-bd01-47a4-a9e6-b9c4edd0541f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:51.469741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c5b5f-bd01-47a4-a9e6-b9c4edd0541f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:51.470015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c5b5f-bd01-47a4-a9e6-b9c4edd0541f None admin] PATH_INFO: `/v3/users/75d244813df045509331a20d8ade3816` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:51.471376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c5b5f-bd01-47a4-a9e6-b9c4edd0541f None admin] RBAC: Authorizing `identity:get_user(user_id=75d244813df045509331a20d8ade3816)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:51.472968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c5b5f-bd01-47a4-a9e6-b9c4edd0541f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:51.474648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 556/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:51 2022] GET /identity/v3/users/75d244813df045509331a20d8ade3816 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:51.480422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37863a-ee26-4a93-9b0f-b810dd9ed321 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:51.567992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:51.582542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37863a-ee26-4a93-9b0f-b810dd9ed321 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:51.611242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870d29-e3a7-4f87-b774-85186608bafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:51.612095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870d29-e3a7-4f87-b774-85186608bafa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:51.612380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870d29-e3a7-4f87-b774-85186608bafa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:51.612658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870d29-e3a7-4f87-b774-85186608bafa None admin] PATH_INFO: `/v3/projects/c0958590f98048beb2af925c61e7ae33` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:51.613824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870d29-e3a7-4f87-b774-85186608bafa None admin] RBAC: Authorizing `identity:get_project(project_id=c0958590f98048beb2af925c61e7ae33)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:51.615275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870d29-e3a7-4f87-b774-85186608bafa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:51.617005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 566/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:34:51 2022] GET /identity/v3/projects/c0958590f98048beb2af925c61e7ae33 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:51.622941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c5b5f-bd01-47a4-a9e6-b9c4edd0541f None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:51.648918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:51.720994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c5b5f-bd01-47a4-a9e6-b9c4edd0541f None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:51.757009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d419-5807-44bf-b96b-9ef16d0996aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:51.758495 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d419-5807-44bf-b96b-9ef16d0996aa None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:51.758779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d419-5807-44bf-b96b-9ef16d0996aa None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:51.759055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d419-5807-44bf-b96b-9ef16d0996aa None admin] PATH_INFO: `/v3/projects/c0958590f98048beb2af925c61e7ae33/users/75d244813df045509331a20d8ade3816/roles/0053c5c9a9f74809be6ecfcdeb35c100` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:51.761259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7d419-5807-44bf-b96b-9ef16d0996aa None admin] RBAC: Authorizing `identity:create_grant(project_id=c0958590f98048beb2af925c61e7ae33, user_id=75d244813df045509331a20d8ade3816, role_id=0053c5c9a9f74809be6ecfcdeb35c100)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:51.762733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7d419-5807-44bf-b96b-9ef16d0996aa None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:51.871113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 557/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:34:51 2022] PUT /identity/v3/projects/c0958590f98048beb2af925c61e7ae33/users/75d244813df045509331a20d8ade3816/roles/0053c5c9a9f74809be6ecfcdeb35c100 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:34:53.868991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18074e-839c-4e7e-b990-32b26e970b79 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:53.869529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18074e-839c-4e7e-b990-32b26e970b79 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:53.869529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18074e-839c-4e7e-b990-32b26e970b79 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:53.870961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 567/1124] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:53.876178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373801f4-4be7-44c2-a967-fd466a90680e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:53.876628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373801f4-4be7-44c2-a967-fd466a90680e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:53.876730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373801f4-4be7-44c2-a967-fd466a90680e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:53.893741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-373801f4-4be7-44c2-a967-fd466a90680e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:53.894962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-373801f4-4be7-44c2-a967-fd466a90680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:53.959900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 558/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:34:53.984135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18074e-839c-4e7e-b990-32b26e970b79 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:54.084452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18074e-839c-4e7e-b990-32b26e970b79 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:54.118549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b55d3-df22-474c-b680-1b4a8b6cdf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:54.119391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b55d3-df22-474c-b680-1b4a8b6cdf25 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:54.119679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b55d3-df22-474c-b680-1b4a8b6cdf25 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:54.119958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b55d3-df22-474c-b680-1b4a8b6cdf25 None admin] PATH_INFO: `/v3/roles/0053c5c9a9f74809be6ecfcdeb35c100` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:54.121431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b55d3-df22-474c-b680-1b4a8b6cdf25 None admin] RBAC: Authorizing `identity:get_role(role_id=0053c5c9a9f74809be6ecfcdeb35c100)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:54.123242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b55d3-df22-474c-b680-1b4a8b6cdf25 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:54.124624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 568/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:53 2022] GET /identity/v3/roles/0053c5c9a9f74809be6ecfcdeb35c100 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:54.130662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373801f4-4be7-44c2-a967-fd466a90680e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:54.146476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:54.227935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373801f4-4be7-44c2-a967-fd466a90680e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:54.262477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652a01f-d350-4fa6-a45c-cf4d50f295c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:54.263586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a01f-d350-4fa6-a45c-cf4d50f295c4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:54.263865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a01f-d350-4fa6-a45c-cf4d50f295c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:54.264144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a01f-d350-4fa6-a45c-cf4d50f295c4 None admin] PATH_INFO: `/v3/users/75d244813df045509331a20d8ade3816` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:54.265338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652a01f-d350-4fa6-a45c-cf4d50f295c4 None admin] RBAC: Authorizing `identity:get_user(user_id=75d244813df045509331a20d8ade3816)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:54.266785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652a01f-d350-4fa6-a45c-cf4d50f295c4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:54.268388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 559/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:34:54 2022] GET /identity/v3/users/75d244813df045509331a20d8ade3816 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:54.274206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b55d3-df22-474c-b680-1b4a8b6cdf25 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:54.300729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:54.371150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b55d3-df22-474c-b680-1b4a8b6cdf25 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:54.403184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20669368-698a-4110-82d6-c6ce3bad21db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:54.403817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20669368-698a-4110-82d6-c6ce3bad21db None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:54.404104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20669368-698a-4110-82d6-c6ce3bad21db None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:54.404376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20669368-698a-4110-82d6-c6ce3bad21db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:54.468396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20669368-698a-4110-82d6-c6ce3bad21db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:54.469822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20669368-698a-4110-82d6-c6ce3bad21db None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:54.495926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:54.566114 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 569/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:34:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:34:54.572092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652a01f-d350-4fa6-a45c-cf4d50f295c4 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:54.653333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:54.671708 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652a01f-d350-4fa6-a45c-cf4d50f295c4 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:54.704886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85feaa-9e79-4e05-8c25-c5b75c60c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:54.705731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85feaa-9e79-4e05-8c25-c5b75c60c52d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:54.706009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85feaa-9e79-4e05-8c25-c5b75c60c52d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:54.706313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85feaa-9e79-4e05-8c25-c5b75c60c52d None admin] PATH_INFO: `/v3/projects/c0958590f98048beb2af925c61e7ae33` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:54.707463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85feaa-9e79-4e05-8c25-c5b75c60c52d None admin] RBAC: Authorizing `identity:get_project(project_id=c0958590f98048beb2af925c61e7ae33)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:54.708880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85feaa-9e79-4e05-8c25-c5b75c60c52d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:54.711115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 560/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:34:54 2022] GET /identity/v3/projects/c0958590f98048beb2af925c61e7ae33 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:54.717231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20669368-698a-4110-82d6-c6ce3bad21db None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:54.814017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20669368-698a-4110-82d6-c6ce3bad21db None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:54.839217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:54.847792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac947d-2d87-4de7-b6e7-1391a4c9d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:54.851705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac947d-2d87-4de7-b6e7-1391a4c9d8ce None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:54.851705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac947d-2d87-4de7-b6e7-1391a4c9d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:54.851705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac947d-2d87-4de7-b6e7-1391a4c9d8ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:54.851705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac947d-2d87-4de7-b6e7-1391a4c9d8ce None admin] RBAC: Adding query filter params (role.id=0053c5c9a9f74809be6ecfcdeb35c100, scope.project.id=c0958590f98048beb2af925c61e7ae33, user.id=75d244813df045509331a20d8ade3816) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:34:54.851705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac947d-2d87-4de7-b6e7-1391a4c9d8ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:54.852288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac947d-2d87-4de7-b6e7-1391a4c9d8ce None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:54.857891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 570/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:34:54 2022] GET /identity/v3/role_assignments?user.id=75d244813df045509331a20d8ade3816&scope.project.id=c0958590f98048beb2af925c61e7ae33&role.id=0053c5c9a9f74809be6ecfcdeb35c100 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:56.877782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5b8e0-2654-4dbb-acb5-3ee2e5eb5987 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:56.878374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5b8e0-2654-4dbb-acb5-3ee2e5eb5987 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:56.878374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5b8e0-2654-4dbb-acb5-3ee2e5eb5987 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:56.879726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 561/1131] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:56.884823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d4d4a-59b5-42ee-9a2d-cf1929aace66 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:56.885220 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d4d4a-59b5-42ee-9a2d-cf1929aace66 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:56.885386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d4d4a-59b5-42ee-9a2d-cf1929aace66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:56.902185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e53d4d4a-59b5-42ee-9a2d-cf1929aace66 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:56.903371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e53d4d4a-59b5-42ee-9a2d-cf1929aace66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:56.968709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 571/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:56.992978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5b8e0-2654-4dbb-acb5-3ee2e5eb5987 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:57.091303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5b8e0-2654-4dbb-acb5-3ee2e5eb5987 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:57.124056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f976e-453e-4cda-a18f-8fade9d31b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:57.124835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f976e-453e-4cda-a18f-8fade9d31b4c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:57.125117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f976e-453e-4cda-a18f-8fade9d31b4c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:57.125391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f976e-453e-4cda-a18f-8fade9d31b4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:57.126578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f976e-453e-4cda-a18f-8fade9d31b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:57.128005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f976e-453e-4cda-a18f-8fade9d31b4c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:57.129603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 562/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:57.135499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d4d4a-59b5-42ee-9a2d-cf1929aace66 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:57.232595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d4d4a-59b5-42ee-9a2d-cf1929aace66 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:57.252589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:57.266572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15812ef4-7065-4ad9-a03a-6939b190a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:57.267230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15812ef4-7065-4ad9-a03a-6939b190a061 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:57.267518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15812ef4-7065-4ad9-a03a-6939b190a061 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:57.267796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15812ef4-7065-4ad9-a03a-6939b190a061 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:57.268506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15812ef4-7065-4ad9-a03a-6939b190a061 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:57.269968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15812ef4-7065-4ad9-a03a-6939b190a061 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:57.375176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 572/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:34:57 2022] POST /identity/v3/projects => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:59.437517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4558aa2-92d0-42c6-ab10-622b498bd81c None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:59.438126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4558aa2-92d0-42c6-ab10-622b498bd81c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:59.438126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4558aa2-92d0-42c6-ab10-622b498bd81c None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:59.439468 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 563/1135] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:59.445443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0f23-cc9a-4be1-bd12-0145ce4c221b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:59.445844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0f23-cc9a-4be1-bd12-0145ce4c221b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:59.445997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0f23-cc9a-4be1-bd12-0145ce4c221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:59.462351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-3acc0f23-cc9a-4be1-bd12-0145ce4c221b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:59.463535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3acc0f23-cc9a-4be1-bd12-0145ce4c221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:59.529055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 573/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:34:59.553658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4558aa2-92d0-42c6-ab10-622b498bd81c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:59.573275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:59.655020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4558aa2-92d0-42c6-ab10-622b498bd81c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:59.688789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9138602-14ea-41e2-ab30-6b3da794d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:59.689499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9138602-14ea-41e2-ab30-6b3da794d915 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:59.689782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9138602-14ea-41e2-ab30-6b3da794d915 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:59.690058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9138602-14ea-41e2-ab30-6b3da794d915 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:59.691259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9138602-14ea-41e2-ab30-6b3da794d915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:59.692687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9138602-14ea-41e2-ab30-6b3da794d915 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:59.694324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 564/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:34:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:34:59.700165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc0f23-cc9a-4be1-bd12-0145ce4c221b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:59.800313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc0f23-cc9a-4be1-bd12-0145ce4c221b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:59.801812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:59.838589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a4f09-9221-4790-9c2a-fb510b20cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:59.839261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a4f09-9221-4790-9c2a-fb510b20cf93 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:59.839547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a4f09-9221-4790-9c2a-fb510b20cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:59.839828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a4f09-9221-4790-9c2a-fb510b20cf93 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:59.840546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a4f09-9221-4790-9c2a-fb510b20cf93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:59.841975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a4f09-9221-4790-9c2a-fb510b20cf93 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:59.956928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 574/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:34:59 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:35:02.005037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54b7a5-609e-4467-a442-02f938cb422a None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.005540 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54b7a5-609e-4467-a442-02f938cb422a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.005540 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54b7a5-609e-4467-a442-02f938cb422a None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.006914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 565/1139] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:02.012646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd775b-fd65-475e-8040-8e0ce79dc7a7 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.013151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd775b-fd65-475e-8040-8e0ce79dc7a7 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.013507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd775b-fd65-475e-8040-8e0ce79dc7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.031090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-77bd775b-fd65-475e-8040-8e0ce79dc7a7 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:02.032256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-77bd775b-fd65-475e-8040-8e0ce79dc7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:02.100064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 575/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:02.122854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54b7a5-609e-4467-a442-02f938cb422a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:02.207479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:02.222346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54b7a5-609e-4467-a442-02f938cb422a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:02.256266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ad5ff-9971-4e64-831d-a07180c3af65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:02.256976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ad5ff-9971-4e64-831d-a07180c3af65 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.257802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ad5ff-9971-4e64-831d-a07180c3af65 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.258076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ad5ff-9971-4e64-831d-a07180c3af65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.268061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ad5ff-9971-4e64-831d-a07180c3af65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-7d5ad5ff-9971-4e64-831d-a07180c3af65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:35:02.275650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:35:02.276935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:35:02.278074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 566/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:35:02.282870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd775b-fd65-475e-8040-8e0ce79dc7a7 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:02.368399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:02.379908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd775b-fd65-475e-8040-8e0ce79dc7a7 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:02.413527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:02.414220 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.414510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.414792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.415537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:02.415848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:02.417209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:02.425102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 576/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:02.431486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ad5ff-9971-4e64-831d-a07180c3af65 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:02.530670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ad5ff-9971-4e64-831d-a07180c3af65 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:02.563828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72043-8555-4cde-ac3a-046a4b5812b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:02.564688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72043-8555-4cde-ac3a-046a4b5812b3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.564964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72043-8555-4cde-ac3a-046a4b5812b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.565240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72043-8555-4cde-ac3a-046a4b5812b3 None admin] PATH_INFO: `/v3/users/178a2ab2fd634019bbb15e378259fb87` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.580104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae72043-8555-4cde-ac3a-046a4b5812b3 None admin] RBAC: Authorizing `identity:get_user(user_id=178a2ab2fd634019bbb15e378259fb87)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:02.581577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae72043-8555-4cde-ac3a-046a4b5812b3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:02.583303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 567/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:35:02 2022] GET /identity/v3/users/178a2ab2fd634019bbb15e378259fb87 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:02.589298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:02.689979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc56cd-273c-482f-a75e-219b45883fb2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:02.726884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff9f7-0822-4fbf-91e0-e493ea99d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:02.727534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff9f7-0822-4fbf-91e0-e493ea99d047 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.727823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff9f7-0822-4fbf-91e0-e493ea99d047 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.728105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff9f7-0822-4fbf-91e0-e493ea99d047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.747334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:02.796193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ff9f7-0822-4fbf-91e0-e493ea99d047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:02.797816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ff9f7-0822-4fbf-91e0-e493ea99d047 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:02.896701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 577/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:35:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:35:02.903255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72043-8555-4cde-ac3a-046a4b5812b3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:02.907237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:03.001483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72043-8555-4cde-ac3a-046a4b5812b3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:03.035402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13eb16-c641-4e3b-b27c-1342e1a63ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:03.036253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13eb16-c641-4e3b-b27c-1342e1a63ef7 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:03.036536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13eb16-c641-4e3b-b27c-1342e1a63ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:03.036814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13eb16-c641-4e3b-b27c-1342e1a63ef7 None admin] PATH_INFO: `/v3/projects/e5eb0e0350a04e398ffdcbe529522d71` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:03.037971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13eb16-c641-4e3b-b27c-1342e1a63ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=e5eb0e0350a04e398ffdcbe529522d71)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:03.039449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13eb16-c641-4e3b-b27c-1342e1a63ef7 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:03.041144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 568/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:35:02 2022] GET /identity/v3/projects/e5eb0e0350a04e398ffdcbe529522d71 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:03.047499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff9f7-0822-4fbf-91e0-e493ea99d047 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:03.097459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:03.153358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff9f7-0822-4fbf-91e0-e493ea99d047 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:03.191333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd3c1d-21b0-42f8-b8e5-92c137d1d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:03.191987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd3c1d-21b0-42f8-b8e5-92c137d1d1cd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:03.192275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd3c1d-21b0-42f8-b8e5-92c137d1d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:03.192554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd3c1d-21b0-42f8-b8e5-92c137d1d1cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:03.193384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd3c1d-21b0-42f8-b8e5-92c137d1d1cd None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=e5eb0e0350a04e398ffdcbe529522d71, user.id=178a2ab2fd634019bbb15e378259fb87) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:03.193698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd3c1d-21b0-42f8-b8e5-92c137d1d1cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:03.195721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd3c1d-21b0-42f8-b8e5-92c137d1d1cd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:03.201101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 578/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:35:03 2022] GET /identity/v3/role_assignments?user.id=178a2ab2fd634019bbb15e378259fb87&scope.project.id=e5eb0e0350a04e398ffdcbe529522d71&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:05.205501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621a68-e137-48a0-b2f5-9b52eb494727 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.206030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621a68-e137-48a0-b2f5-9b52eb494727 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.206186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621a68-e137-48a0-b2f5-9b52eb494727 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.207484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 569/1147] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:05.213446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10123-524e-40b7-b5ac-dc2aff1cc000 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.213866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10123-524e-40b7-b5ac-dc2aff1cc000 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.213999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10123-524e-40b7-b5ac-dc2aff1cc000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.231001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5fd10123-524e-40b7-b5ac-dc2aff1cc000 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:05.232180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5fd10123-524e-40b7-b5ac-dc2aff1cc000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:05.299207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 579/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:05.321361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02621a68-e137-48a0-b2f5-9b52eb494727 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:05.392935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:05.424909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02621a68-e137-48a0-b2f5-9b52eb494727 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:05.458775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2941734-babc-4e09-889e-290732bc3b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:05.459484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941734-babc-4e09-889e-290732bc3b67 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.459767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941734-babc-4e09-889e-290732bc3b67 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.460043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941734-babc-4e09-889e-290732bc3b67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.470702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2941734-babc-4e09-889e-290732bc3b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-b2941734-babc-4e09-889e-290732bc3b67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:35:05.479030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:35:05.480157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:35:05.481231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 570/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:35:05.486469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd10123-524e-40b7-b5ac-dc2aff1cc000 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:05.531622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:05.586956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd10123-524e-40b7-b5ac-dc2aff1cc000 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:05.620406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:05.621067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.621351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.621631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.622399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:05.622709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:05.624068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:05.632738 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 580/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:05.638674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2941734-babc-4e09-889e-290732bc3b67 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:05.738690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2941734-babc-4e09-889e-290732bc3b67 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:05.767848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:05.772668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95910d7-52fc-4a27-b8b6-951327b2ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:05.774217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95910d7-52fc-4a27-b8b6-951327b2ec31 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.777186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95910d7-52fc-4a27-b8b6-951327b2ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.777186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95910d7-52fc-4a27-b8b6-951327b2ec31 None admin] PATH_INFO: `/v3/users/178a2ab2fd634019bbb15e378259fb87` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.777186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95910d7-52fc-4a27-b8b6-951327b2ec31 None admin] RBAC: Authorizing `identity:get_user(user_id=178a2ab2fd634019bbb15e378259fb87)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:05.777442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95910d7-52fc-4a27-b8b6-951327b2ec31 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:05.778979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 571/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:35:05 2022] GET /identity/v3/users/178a2ab2fd634019bbb15e378259fb87 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:05.784858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:05.884512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73aab6f-10d6-4b96-823e-2e5d7353e256 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:05.891555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:05.917551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830b304-15db-4172-af6c-45d8f68e5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:05.918438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b304-15db-4172-af6c-45d8f68e5a8a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.918715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b304-15db-4172-af6c-45d8f68e5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.918991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b304-15db-4172-af6c-45d8f68e5a8a None admin] PATH_INFO: `/v3/projects/e5eb0e0350a04e398ffdcbe529522d71` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.920160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830b304-15db-4172-af6c-45d8f68e5a8a None admin] RBAC: Authorizing `identity:get_project(project_id=e5eb0e0350a04e398ffdcbe529522d71)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:05.921580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830b304-15db-4172-af6c-45d8f68e5a8a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:05.923503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 581/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:35:05 2022] GET /identity/v3/projects/e5eb0e0350a04e398ffdcbe529522d71 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:05.930036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95910d7-52fc-4a27-b8b6-951327b2ec31 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:06.028121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95910d7-52fc-4a27-b8b6-951327b2ec31 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:06.060595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd8afc-2586-4e8a-9339-0cbe9b6f0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:06.061477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd8afc-2586-4e8a-9339-0cbe9b6f0a2b None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:06.061757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd8afc-2586-4e8a-9339-0cbe9b6f0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:06.062031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd8afc-2586-4e8a-9339-0cbe9b6f0a2b None admin] PATH_INFO: `/v3/projects/e5eb0e0350a04e398ffdcbe529522d71/users/178a2ab2fd634019bbb15e378259fb87/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:06.064002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd8afc-2586-4e8a-9339-0cbe9b6f0a2b None admin] RBAC: Authorizing `identity:create_grant(project_id=e5eb0e0350a04e398ffdcbe529522d71, user_id=178a2ab2fd634019bbb15e378259fb87, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:06.065432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd8afc-2586-4e8a-9339-0cbe9b6f0a2b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:06.174716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 572/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:35:05 2022] PUT /identity/v3/projects/e5eb0e0350a04e398ffdcbe529522d71/users/178a2ab2fd634019bbb15e378259fb87/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:35:08.190838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1533e81-3782-4358-afee-675ae217870b None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.191370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1533e81-3782-4358-afee-675ae217870b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.191370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1533e81-3782-4358-afee-675ae217870b None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:08.192799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 582/1154] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:08.198248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58958b-da60-4308-aa4d-85207206be22 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.198672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58958b-da60-4308-aa4d-85207206be22 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.198785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58958b-da60-4308-aa4d-85207206be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:08.216900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-cd58958b-da60-4308-aa4d-85207206be22 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:08.218090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cd58958b-da60-4308-aa4d-85207206be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:08.273990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:08.285535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 573/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:08.309734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1533e81-3782-4358-afee-675ae217870b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:08.413112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1533e81-3782-4358-afee-675ae217870b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:08.447432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a047a-b8c3-4bc7-ae67-581f30e9e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:08.448156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a047a-b8c3-4bc7-ae67-581f30e9e807 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.448440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a047a-b8c3-4bc7-ae67-581f30e9e807 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.448714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a047a-b8c3-4bc7-ae67-581f30e9e807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:08.461583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a047a-b8c3-4bc7-ae67-581f30e9e807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-0c2a047a-b8c3-4bc7-ae67-581f30e9e807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:35:08.469291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:35:08.470530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:35:08.471504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 583/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:35:08.477401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58958b-da60-4308-aa4d-85207206be22 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:08.581950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58958b-da60-4308-aa4d-85207206be22 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:08.619405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:08.620076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.620365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.620642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:08.621397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:08.621707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:08.623112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:08.632054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 574/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:35:08.638156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a047a-b8c3-4bc7-ae67-581f30e9e807 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:08.673516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:08.746623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a047a-b8c3-4bc7-ae67-581f30e9e807 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:08.781845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17022c56-3714-4063-965f-defa5954e5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:08.782757 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17022c56-3714-4063-965f-defa5954e5dd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.783042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17022c56-3714-4063-965f-defa5954e5dd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.783318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17022c56-3714-4063-965f-defa5954e5dd None admin] PATH_INFO: `/v3/users/178a2ab2fd634019bbb15e378259fb87` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:08.784512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17022c56-3714-4063-965f-defa5954e5dd None admin] RBAC: Authorizing `identity:get_user(user_id=178a2ab2fd634019bbb15e378259fb87)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:08.785941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17022c56-3714-4063-965f-defa5954e5dd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:08.787630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 584/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:35:08 2022] GET /identity/v3/users/178a2ab2fd634019bbb15e378259fb87 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:08.794002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:08.850172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:08.899513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76e13b-587c-4a11-9d3c-7dcc219acdff None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:08.933678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b065d08-11f7-4f89-929b-bc60deb49d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:08.934354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065d08-11f7-4f89-929b-bc60deb49d7d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.934641 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065d08-11f7-4f89-929b-bc60deb49d7d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.934918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065d08-11f7-4f89-929b-bc60deb49d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:09.004151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b065d08-11f7-4f89-929b-bc60deb49d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:09.005521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b065d08-11f7-4f89-929b-bc60deb49d7d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:09.070648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:09.122285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 575/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:35:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:35:09.128304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17022c56-3714-4063-965f-defa5954e5dd None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:09.233804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17022c56-3714-4063-965f-defa5954e5dd None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:09.235421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:09.268119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66b27-ef07-4961-9de3-e53ca6ee8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:09.268915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66b27-ef07-4961-9de3-e53ca6ee8057 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:09.269402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66b27-ef07-4961-9de3-e53ca6ee8057 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:09.269849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66b27-ef07-4961-9de3-e53ca6ee8057 None admin] PATH_INFO: `/v3/projects/e5eb0e0350a04e398ffdcbe529522d71` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:09.271349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66b27-ef07-4961-9de3-e53ca6ee8057 None admin] RBAC: Authorizing `identity:get_project(project_id=e5eb0e0350a04e398ffdcbe529522d71)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:09.273306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66b27-ef07-4961-9de3-e53ca6ee8057 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:09.275046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 585/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:35:09 2022] GET /identity/v3/projects/e5eb0e0350a04e398ffdcbe529522d71 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:09.281444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b065d08-11f7-4f89-929b-bc60deb49d7d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:09.377817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b065d08-11f7-4f89-929b-bc60deb49d7d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:09.413056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fdd14-4f71-4c6a-9e1f-cb8afc96c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:09.413701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fdd14-4f71-4c6a-9e1f-cb8afc96c70f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:09.413987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fdd14-4f71-4c6a-9e1f-cb8afc96c70f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:09.414292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fdd14-4f71-4c6a-9e1f-cb8afc96c70f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:09.415114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fdd14-4f71-4c6a-9e1f-cb8afc96c70f None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=e5eb0e0350a04e398ffdcbe529522d71, user.id=178a2ab2fd634019bbb15e378259fb87) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:09.415428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fdd14-4f71-4c6a-9e1f-cb8afc96c70f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:09.416960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fdd14-4f71-4c6a-9e1f-cb8afc96c70f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:09.422832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 576/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:35:09 2022] GET /identity/v3/role_assignments?user.id=178a2ab2fd634019bbb15e378259fb87&scope.project.id=e5eb0e0350a04e398ffdcbe529522d71&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:11.459684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3672a1-58b0-4121-9500-d2e10e2b0a05 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:11.460214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3672a1-58b0-4121-9500-d2e10e2b0a05 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:11.460308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3672a1-58b0-4121-9500-d2e10e2b0a05 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:11.461623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 586/1162] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:11.467212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5577-f6b0-4db2-bc5e-92896f6abb4c None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:11.467636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5577-f6b0-4db2-bc5e-92896f6abb4c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:11.467770 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5577-f6b0-4db2-bc5e-92896f6abb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:11.484376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a06b5577-f6b0-4db2-bc5e-92896f6abb4c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:11.485565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a06b5577-f6b0-4db2-bc5e-92896f6abb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:11.496656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:11.552587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 577/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:11.575680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3672a1-58b0-4121-9500-d2e10e2b0a05 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:11.675106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3672a1-58b0-4121-9500-d2e10e2b0a05 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:11.708038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e6c7c-4c57-434b-bf0a-ada5b5886cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:11.708671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6c7c-4c57-434b-bf0a-ada5b5886cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:11.708952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6c7c-4c57-434b-bf0a-ada5b5886cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:11.709225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6c7c-4c57-434b-bf0a-ada5b5886cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:11.749084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:11.778357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e6c7c-4c57-434b-bf0a-ada5b5886cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:11.779798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e6c7c-4c57-434b-bf0a-ada5b5886cc4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:11.875081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 587/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:35:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:35:11.881244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b5577-f6b0-4db2-bc5e-92896f6abb4c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:11.979199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b5577-f6b0-4db2-bc5e-92896f6abb4c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:12.012957 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05941533-f07b-4f9e-a71a-fe2399c49560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:12.013949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05941533-f07b-4f9e-a71a-fe2399c49560 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:12.014264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05941533-f07b-4f9e-a71a-fe2399c49560 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:12.014545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05941533-f07b-4f9e-a71a-fe2399c49560 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:12.021094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05941533-f07b-4f9e-a71a-fe2399c49560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:12.022560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05941533-f07b-4f9e-a71a-fe2399c49560 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-05941533-f07b-4f9e-a71a-fe2399c49560 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:35:12.036715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:35:12.038031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:35:12.039120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 578/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:35:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:35:12.043905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e6c7c-4c57-434b-bf0a-ada5b5886cc4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:12.110788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:12.144058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e6c7c-4c57-434b-bf0a-ada5b5886cc4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:12.177483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a36ba-0603-45f0-86a0-649b07a18417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:12.178149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a36ba-0603-45f0-86a0-649b07a18417 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:12.178442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a36ba-0603-45f0-86a0-649b07a18417 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:12.178718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a36ba-0603-45f0-86a0-649b07a18417 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:12.180059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a36ba-0603-45f0-86a0-649b07a18417 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:12.180266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a36ba-0603-45f0-86a0-649b07a18417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:12.181614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a36ba-0603-45f0-86a0-649b07a18417 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:12.188998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 588/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Jul 11 14:35:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:14.184931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cefc88-9fb0-44c3-bbff-75a8f05138c2 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:14.185457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cefc88-9fb0-44c3-bbff-75a8f05138c2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:14.185577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cefc88-9fb0-44c3-bbff-75a8f05138c2 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:14.186948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 579/1167] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:14.192145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd273b-0d0e-4a7b-abeb-915dfef44c85 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:14.192576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd273b-0d0e-4a7b-abeb-915dfef44c85 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:14.192705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd273b-0d0e-4a7b-abeb-915dfef44c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:14.209149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-afdd273b-0d0e-4a7b-abeb-915dfef44c85 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:14.210884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-afdd273b-0d0e-4a7b-abeb-915dfef44c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:14.275509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 589/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:35:14.299343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cefc88-9fb0-44c3-bbff-75a8f05138c2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:14.309002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:14.401741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cefc88-9fb0-44c3-bbff-75a8f05138c2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:14.434579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318103b-40f8-49eb-b003-77651d11ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:14.435309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318103b-40f8-49eb-b003-77651d11ef25 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:14.435518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318103b-40f8-49eb-b003-77651d11ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:14.435793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318103b-40f8-49eb-b003-77651d11ef25 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:14.436538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318103b-40f8-49eb-b003-77651d11ef25 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:14.438300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318103b-40f8-49eb-b003-77651d11ef25 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:14.511213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 580/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Mon Jul 11 14:35:14 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:35:16.547094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c6d6-19be-4ce8-b5ef-80e447fd7296 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.547656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c6d6-19be-4ce8-b5ef-80e447fd7296 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.547656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c6d6-19be-4ce8-b5ef-80e447fd7296 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.549021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 590/1170] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:16.554620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad6e11-13fd-417e-ad88-6eca513fbe18 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.555041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad6e11-13fd-417e-ad88-6eca513fbe18 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.555183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad6e11-13fd-417e-ad88-6eca513fbe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.572166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-92ad6e11-13fd-417e-ad88-6eca513fbe18 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:16.573363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-92ad6e11-13fd-417e-ad88-6eca513fbe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:16.630658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:16.638753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 581/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:16.661968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c6d6-19be-4ce8-b5ef-80e447fd7296 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:16.724595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:16.763848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c6d6-19be-4ce8-b5ef-80e447fd7296 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:16.798875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda8789-eec2-4f5e-b90e-a2e6d7bfd93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:16.799656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda8789-eec2-4f5e-b90e-a2e6d7bfd93c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.799945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda8789-eec2-4f5e-b90e-a2e6d7bfd93c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.800225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda8789-eec2-4f5e-b90e-a2e6d7bfd93c None admin] PATH_INFO: `/v3/domains/9ff1291b0df34bdebdc3515d5dd88bf4` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.810563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda8789-eec2-4f5e-b90e-a2e6d7bfd93c None admin] RBAC: Authorizing `identity:get_domain(domain_id=9ff1291b0df34bdebdc3515d5dd88bf4)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:16.812013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda8789-eec2-4f5e-b90e-a2e6d7bfd93c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:16.813751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 591/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Jul 11 14:35:16 2022] GET /identity/v3/domains/9ff1291b0df34bdebdc3515d5dd88bf4 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:16.820475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad6e11-13fd-417e-ad88-6eca513fbe18 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:16.917590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad6e11-13fd-417e-ad88-6eca513fbe18 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:16.952166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1a3db-889d-4051-87e7-8576db34b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:16.952820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1a3db-889d-4051-87e7-8576db34b91d None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.953106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1a3db-889d-4051-87e7-8576db34b91d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.953391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1a3db-889d-4051-87e7-8576db34b91d None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.954090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1a3db-889d-4051-87e7-8576db34b91d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:16.955553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1a3db-889d-4051-87e7-8576db34b91d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:17.054775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 582/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:35:16 2022] POST /identity/v3/projects => generated 361 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:35:19.131084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91be3c9-8570-4095-9033-f4fd733c87e6 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:19.131646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91be3c9-8570-4095-9033-f4fd733c87e6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:19.131646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91be3c9-8570-4095-9033-f4fd733c87e6 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:19.133018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 592/1174] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:19.138548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029aaf-98de-4968-8c07-760975012929 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:19.138996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029aaf-98de-4968-8c07-760975012929 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:19.139097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029aaf-98de-4968-8c07-760975012929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:19.155417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a0029aaf-98de-4968-8c07-760975012929 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:19.156584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a0029aaf-98de-4968-8c07-760975012929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:19.199784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:19.221767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 583/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:19.247756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91be3c9-8570-4095-9033-f4fd733c87e6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:19.348598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91be3c9-8570-4095-9033-f4fd733c87e6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:19.371861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:19.385206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967f9fc-5b96-44d6-824a-2af14c3b6d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:19.385206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967f9fc-5b96-44d6-824a-2af14c3b6d65 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:19.385206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967f9fc-5b96-44d6-824a-2af14c3b6d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:19.385206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967f9fc-5b96-44d6-824a-2af14c3b6d65 None admin] PATH_INFO: `/v3/domains/9ff1291b0df34bdebdc3515d5dd88bf4` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:19.385676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967f9fc-5b96-44d6-824a-2af14c3b6d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9ff1291b0df34bdebdc3515d5dd88bf4)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:19.385963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967f9fc-5b96-44d6-824a-2af14c3b6d65 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:19.387603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 593/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Jul 11 14:35:19 2022] GET /identity/v3/domains/9ff1291b0df34bdebdc3515d5dd88bf4 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:19.393631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029aaf-98de-4968-8c07-760975012929 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:19.491934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029aaf-98de-4968-8c07-760975012929 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:19.526019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34d0f6-878c-4d69-8296-2df3b61a5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:19.526719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d0f6-878c-4d69-8296-2df3b61a5736 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:19.527006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d0f6-878c-4d69-8296-2df3b61a5736 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:19.527286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d0f6-878c-4d69-8296-2df3b61a5736 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:19.527984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34d0f6-878c-4d69-8296-2df3b61a5736 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:19.529414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34d0f6-878c-4d69-8296-2df3b61a5736 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:19.619709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 584/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:35:19 2022] POST /identity/v3/users => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:35:21.685636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146dc94-faec-4d90-bf2f-91a3fe1fd91b None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:21.686225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146dc94-faec-4d90-bf2f-91a3fe1fd91b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:21.686225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146dc94-faec-4d90-bf2f-91a3fe1fd91b None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:21.687606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 594/1178] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:21.692900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17541bc-e9bd-4801-b1cd-892342c04f4d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:21.693331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17541bc-e9bd-4801-b1cd-892342c04f4d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:21.693464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17541bc-e9bd-4801-b1cd-892342c04f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:21.710503 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c17541bc-e9bd-4801-b1cd-892342c04f4d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:21.711694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c17541bc-e9bd-4801-b1cd-892342c04f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:21.737849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:21.782944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 585/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:21.807711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146dc94-faec-4d90-bf2f-91a3fe1fd91b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:21.910258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146dc94-faec-4d90-bf2f-91a3fe1fd91b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:21.950864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19726d1a-f14b-40a3-ab1e-3e0cdfebb63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:21.951540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726d1a-f14b-40a3-ab1e-3e0cdfebb63c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:21.951822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726d1a-f14b-40a3-ab1e-3e0cdfebb63c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:21.952092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726d1a-f14b-40a3-ab1e-3e0cdfebb63c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:21.962432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19726d1a-f14b-40a3-ab1e-3e0cdfebb63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-19726d1a-f14b-40a3-ab1e-3e0cdfebb63c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:35:21.969947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:35:21.971226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:35:21.972182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 595/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:35:21.977286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17541bc-e9bd-4801-b1cd-892342c04f4d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:22.087114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17541bc-e9bd-4801-b1cd-892342c04f4d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:22.121302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:22.121964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:22.122280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:22.122560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:22.123297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:22.123603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:22.124975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:22.133144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 586/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:22.139223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19726d1a-f14b-40a3-ab1e-3e0cdfebb63c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:22.191588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:22.237833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19726d1a-f14b-40a3-ab1e-3e0cdfebb63c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:22.271268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b28db-7b8f-4a12-be7b-f3230614bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:22.272116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b28db-7b8f-4a12-be7b-f3230614bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:22.272412 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b28db-7b8f-4a12-be7b-f3230614bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:22.272685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b28db-7b8f-4a12-be7b-f3230614bcd3 None admin] PATH_INFO: `/v3/users/bb072ce9249b4e79bb299be3edf723e5` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:22.285295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b28db-7b8f-4a12-be7b-f3230614bcd3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb072ce9249b4e79bb299be3edf723e5)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:22.286754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b28db-7b8f-4a12-be7b-f3230614bcd3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:22.288944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 596/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:35:22 2022] GET /identity/v3/users/bb072ce9249b4e79bb299be3edf723e5 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:22.294760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:22.322875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:22.394376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709481-9e03-4a1f-8a78-49106dfc809b None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:22.427676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc26f0-a469-4387-9ca3-f1aa1f40e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:22.428328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc26f0-a469-4387-9ca3-f1aa1f40e71c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:22.428616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc26f0-a469-4387-9ca3-f1aa1f40e71c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:22.429518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc26f0-a469-4387-9ca3-f1aa1f40e71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:22.497138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc26f0-a469-4387-9ca3-f1aa1f40e71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:22.498549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc26f0-a469-4387-9ca3-f1aa1f40e71c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:22.525184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:22.596058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 587/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:35:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:35:22.602602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b28db-7b8f-4a12-be7b-f3230614bcd3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:22.707074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b28db-7b8f-4a12-be7b-f3230614bcd3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:22.718048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:22.740879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dcab1-4cf6-42b2-97aa-93a3aa9f6c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:22.743289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dcab1-4cf6-42b2-97aa-93a3aa9f6c26 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:22.743289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dcab1-4cf6-42b2-97aa-93a3aa9f6c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:22.743289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dcab1-4cf6-42b2-97aa-93a3aa9f6c26 None admin] PATH_INFO: `/v3/projects/01359944f8af41ae820314160d421ec2` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:22.743963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dcab1-4cf6-42b2-97aa-93a3aa9f6c26 None admin] RBAC: Authorizing `identity:get_project(project_id=01359944f8af41ae820314160d421ec2)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:22.745673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dcab1-4cf6-42b2-97aa-93a3aa9f6c26 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:22.747091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 597/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:35:22 2022] GET /identity/v3/projects/01359944f8af41ae820314160d421ec2 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:22.753212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc26f0-a469-4387-9ca3-f1aa1f40e71c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:22.854194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc26f0-a469-4387-9ca3-f1aa1f40e71c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:22.879508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:22.888848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0653a-00f0-473d-a179-8309942d6e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:22.889502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0653a-00f0-473d-a179-8309942d6e8d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:22.889803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0653a-00f0-473d-a179-8309942d6e8d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:22.890067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0653a-00f0-473d-a179-8309942d6e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:22.890935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0653a-00f0-473d-a179-8309942d6e8d None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=01359944f8af41ae820314160d421ec2, user.id=bb072ce9249b4e79bb299be3edf723e5) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:22.891798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0653a-00f0-473d-a179-8309942d6e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:22.892667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0653a-00f0-473d-a179-8309942d6e8d None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:22.898875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 588/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:35:22 2022] GET /identity/v3/role_assignments?user.id=bb072ce9249b4e79bb299be3edf723e5&scope.project.id=01359944f8af41ae820314160d421ec2&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:24.901381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2eeee-90c1-49cd-93af-b283cc477df8 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:24.901901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2eeee-90c1-49cd-93af-b283cc477df8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:24.902012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2eeee-90c1-49cd-93af-b283cc477df8 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:24.903363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 598/1186] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:24.908729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c9776-bf87-48a0-bfaf-c00f1b1275ab None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:24.909183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c9776-bf87-48a0-bfaf-c00f1b1275ab None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:24.909298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c9776-bf87-48a0-bfaf-c00f1b1275ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:24.926270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-373c9776-bf87-48a0-bfaf-c00f1b1275ab None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:24.927456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-373c9776-bf87-48a0-bfaf-c00f1b1275ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:24.991651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 589/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:25.014422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2eeee-90c1-49cd-93af-b283cc477df8 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:25.113803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2eeee-90c1-49cd-93af-b283cc477df8 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:25.147032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700eea1-5143-4d18-9c36-239143ab25d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:25.148412 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700eea1-5143-4d18-9c36-239143ab25d3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:25.148696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700eea1-5143-4d18-9c36-239143ab25d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:25.148972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700eea1-5143-4d18-9c36-239143ab25d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:25.158922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700eea1-5143-4d18-9c36-239143ab25d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-5700eea1-5143-4d18-9c36-239143ab25d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:35:25.166521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:35:25.167654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:35:25.168893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 599/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:35:25.173819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c9776-bf87-48a0-bfaf-c00f1b1275ab None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:25.270703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c9776-bf87-48a0-bfaf-c00f1b1275ab None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:25.290528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:25.304032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:25.304697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:25.304981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:25.305261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:25.306006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:25.306354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:25.307720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:25.315748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 590/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:25.322229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700eea1-5143-4d18-9c36-239143ab25d3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:25.360945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:25.422223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700eea1-5143-4d18-9c36-239143ab25d3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:25.455233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2105a-5084-4983-9baa-d698167201fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:25.456093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2105a-5084-4983-9baa-d698167201fa None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:25.456376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2105a-5084-4983-9baa-d698167201fa None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:25.456651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2105a-5084-4983-9baa-d698167201fa None admin] PATH_INFO: `/v3/users/bb072ce9249b4e79bb299be3edf723e5` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:25.457839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2105a-5084-4983-9baa-d698167201fa None admin] RBAC: Authorizing `identity:get_user(user_id=bb072ce9249b4e79bb299be3edf723e5)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:25.459289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2105a-5084-4983-9baa-d698167201fa None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:25.461427 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 600/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:35:25 2022] GET /identity/v3/users/bb072ce9249b4e79bb299be3edf723e5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:25.467354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:25.564400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76570-343e-4197-9aa9-bdc4d0c115c5 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:25.597702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694bd1-a70a-4ca7-84e2-0b2d8669795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:25.598590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694bd1-a70a-4ca7-84e2-0b2d8669795e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:25.598874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694bd1-a70a-4ca7-84e2-0b2d8669795e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:25.599149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694bd1-a70a-4ca7-84e2-0b2d8669795e None admin] PATH_INFO: `/v3/projects/01359944f8af41ae820314160d421ec2` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:25.600308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd694bd1-a70a-4ca7-84e2-0b2d8669795e None admin] RBAC: Authorizing `identity:get_project(project_id=01359944f8af41ae820314160d421ec2)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:25.602351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd694bd1-a70a-4ca7-84e2-0b2d8669795e None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:25.604035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 591/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:35:25 2022] GET /identity/v3/projects/01359944f8af41ae820314160d421ec2 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:25.611001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2105a-5084-4983-9baa-d698167201fa None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:25.707347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2105a-5084-4983-9baa-d698167201fa None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:25.714577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:25.740551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb792-0560-468a-832c-971dfbc94bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:25.741443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb792-0560-468a-832c-971dfbc94bb8 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:25.741725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb792-0560-468a-832c-971dfbc94bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:25.742031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb792-0560-468a-832c-971dfbc94bb8 None admin] PATH_INFO: `/v3/projects/01359944f8af41ae820314160d421ec2/users/bb072ce9249b4e79bb299be3edf723e5/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:25.744095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eb792-0560-468a-832c-971dfbc94bb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=01359944f8af41ae820314160d421ec2, user_id=bb072ce9249b4e79bb299be3edf723e5, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:25.746165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eb792-0560-468a-832c-971dfbc94bb8 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:25.819238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 601/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:35:25 2022] PUT /identity/v3/projects/01359944f8af41ae820314160d421ec2/users/bb072ce9249b4e79bb299be3edf723e5/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:35:27.809276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd652d-b91e-4bd1-b81b-b293077e55b9 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:27.809790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd652d-b91e-4bd1-b81b-b293077e55b9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:27.809882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd652d-b91e-4bd1-b81b-b293077e55b9 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:27.811217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 592/1193] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:27.816303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade982-c12a-46eb-bcdc-7a12af121413 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:27.816724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade982-c12a-46eb-bcdc-7a12af121413 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:27.816855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade982-c12a-46eb-bcdc-7a12af121413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:27.833939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-eeade982-c12a-46eb-bcdc-7a12af121413 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:27.835142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-eeade982-c12a-46eb-bcdc-7a12af121413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:27.900357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 602/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:35:27.923343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd652d-b91e-4bd1-b81b-b293077e55b9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:27.974233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:28.024718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd652d-b91e-4bd1-b81b-b293077e55b9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:28.058890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3dfaa-a184-454b-93d1-db3697a252f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:28.059670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3dfaa-a184-454b-93d1-db3697a252f1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:28.059949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3dfaa-a184-454b-93d1-db3697a252f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:28.060217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3dfaa-a184-454b-93d1-db3697a252f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:28.070012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3dfaa-a184-454b-93d1-db3697a252f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-d8a3dfaa-a184-454b-93d1-db3697a252f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:35:28.077616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:35:28.078823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:35:28.079753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 593/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:35:28.084854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade982-c12a-46eb-bcdc-7a12af121413 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:28.176678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:28.183052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade982-c12a-46eb-bcdc-7a12af121413 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:28.215374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:28.216042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:28.216328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:28.216670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:28.217626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:28.217999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:28.220023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:28.228610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 603/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:35:28.234377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3dfaa-a184-454b-93d1-db3697a252f1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:28.335771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3dfaa-a184-454b-93d1-db3697a252f1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:28.346037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:28.370014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666584ef-7529-4d66-a6cf-3c95a5bef3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:28.370934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666584ef-7529-4d66-a6cf-3c95a5bef3cd None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:28.371218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666584ef-7529-4d66-a6cf-3c95a5bef3cd None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:28.371511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666584ef-7529-4d66-a6cf-3c95a5bef3cd None admin] PATH_INFO: `/v3/users/bb072ce9249b4e79bb299be3edf723e5` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:28.372728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666584ef-7529-4d66-a6cf-3c95a5bef3cd None admin] RBAC: Authorizing `identity:get_user(user_id=bb072ce9249b4e79bb299be3edf723e5)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:28.374176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666584ef-7529-4d66-a6cf-3c95a5bef3cd None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:28.375798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 594/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Jul 11 14:35:28 2022] GET /identity/v3/users/bb072ce9249b4e79bb299be3edf723e5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:28.381572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:28.481998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f55f4e-35d1-41ed-aa90-c8ab57582e18 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:28.515485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76215f0a-e32d-42b3-90e4-c37482dd3dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:28.516123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76215f0a-e32d-42b3-90e4-c37482dd3dd1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:28.516409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76215f0a-e32d-42b3-90e4-c37482dd3dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:28.516688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76215f0a-e32d-42b3-90e4-c37482dd3dd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:28.544400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:28.583273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76215f0a-e32d-42b3-90e4-c37482dd3dd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:28.584804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76215f0a-e32d-42b3-90e4-c37482dd3dd1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:28.683393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 604/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:35:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:35:28.689198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666584ef-7529-4d66-a6cf-3c95a5bef3cd None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:28.790763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666584ef-7529-4d66-a6cf-3c95a5bef3cd None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:28.824229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd89b1e-07f7-436d-ac3c-662033121095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:28.825073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd89b1e-07f7-436d-ac3c-662033121095 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:28.825353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd89b1e-07f7-436d-ac3c-662033121095 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:28.825628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd89b1e-07f7-436d-ac3c-662033121095 None admin] PATH_INFO: `/v3/projects/01359944f8af41ae820314160d421ec2` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:28.826814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd89b1e-07f7-436d-ac3c-662033121095 None admin] RBAC: Authorizing `identity:get_project(project_id=01359944f8af41ae820314160d421ec2)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:28.828275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd89b1e-07f7-436d-ac3c-662033121095 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:28.830012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 595/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Jul 11 14:35:28 2022] GET /identity/v3/projects/01359944f8af41ae820314160d421ec2 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:28.836683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76215f0a-e32d-42b3-90e4-c37482dd3dd1 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:28.897237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:28.937892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76215f0a-e32d-42b3-90e4-c37482dd3dd1 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:28.971862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b46237-2d96-4f33-aa86-3c8634e9f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:28.972510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b46237-2d96-4f33-aa86-3c8634e9f8bd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:28.972790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b46237-2d96-4f33-aa86-3c8634e9f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:28.973065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b46237-2d96-4f33-aa86-3c8634e9f8bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:28.973887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b46237-2d96-4f33-aa86-3c8634e9f8bd None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=01359944f8af41ae820314160d421ec2, user.id=bb072ce9249b4e79bb299be3edf723e5) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:28.974227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b46237-2d96-4f33-aa86-3c8634e9f8bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:28.975638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b46237-2d96-4f33-aa86-3c8634e9f8bd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:28.981502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 605/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:35:28 2022] GET /identity/v3/role_assignments?user.id=bb072ce9249b4e79bb299be3edf723e5&scope.project.id=01359944f8af41ae820314160d421ec2&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:38.819427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=77 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:38.978804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=39 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:42.015091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6234f-af28-43cd-8775-c057e23676ca None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:42.015664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6234f-af28-43cd-8775-c057e23676ca None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:42.015664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6234f-af28-43cd-8775-c057e23676ca None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:42.016929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 596/1201] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:42.022215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e48e-8dc8-4fb1-9c46-8be7684d7a64 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:42.022646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e48e-8dc8-4fb1-9c46-8be7684d7a64 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:42.022813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e48e-8dc8-4fb1-9c46-8be7684d7a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:42.039401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9ca3e48e-8dc8-4fb1-9c46-8be7684d7a64 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:42.040585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9ca3e48e-8dc8-4fb1-9c46-8be7684d7a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:42.105728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 606/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:36:42.130922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6234f-af28-43cd-8775-c057e23676ca None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:42.237319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6234f-af28-43cd-8775-c057e23676ca None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:42.271934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:42.272680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:42.272967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:42.273246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:42.284959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:42.286444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:42.304806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:42.309800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:42.311576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:42.311576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:42.311576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:42.311576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:42.311576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 597/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:42.312662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3e48e-8dc8-4fb1-9c46-8be7684d7a64 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:42.415440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3e48e-8dc8-4fb1-9c46-8be7684d7a64 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:42.445845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:42.452679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79740f-0700-47f2-9db1-fefc2e8bb8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:42.453350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79740f-0700-47f2-9db1-fefc2e8bb8ad None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:42.453632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79740f-0700-47f2-9db1-fefc2e8bb8ad None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:42.453908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79740f-0700-47f2-9db1-fefc2e8bb8ad None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:42.454669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79740f-0700-47f2-9db1-fefc2e8bb8ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:42.454981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79740f-0700-47f2-9db1-fefc2e8bb8ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:42.456348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79740f-0700-47f2-9db1-fefc2e8bb8ad None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:42.468045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 607/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:42.473730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:42.529034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:42.582414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b319e-be22-40b8-88f7-7bb4bc80b2b0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:42.616142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25060130-ee8a-4ffb-9901-7933304c2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:42.616813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060130-ee8a-4ffb-9901-7933304c2abf None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:42.617096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060130-ee8a-4ffb-9901-7933304c2abf None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:42.617371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060130-ee8a-4ffb-9901-7933304c2abf None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:42.618071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25060130-ee8a-4ffb-9901-7933304c2abf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:42.619528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25060130-ee8a-4ffb-9901-7933304c2abf None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:42.726252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 598/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Jul 11 14:36:42 2022] POST /identity/v3/users => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:36:44.767784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d6b78-d6e2-4dfe-b702-0087f8fa6ddc None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:44.768302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d6b78-d6e2-4dfe-b702-0087f8fa6ddc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:44.768404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d6b78-d6e2-4dfe-b702-0087f8fa6ddc None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:44.769770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 608/1206] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:44.775018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be354c8-e349-4e82-b5c2-4ad6b3631eff None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:44.775468 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be354c8-e349-4e82-b5c2-4ad6b3631eff None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:44.775574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be354c8-e349-4e82-b5c2-4ad6b3631eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:44.793706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-6be354c8-e349-4e82-b5c2-4ad6b3631eff None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:44.794989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6be354c8-e349-4e82-b5c2-4ad6b3631eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:44.864595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 599/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:36:44.888963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d6b78-d6e2-4dfe-b702-0087f8fa6ddc None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:44.993651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d6b78-d6e2-4dfe-b702-0087f8fa6ddc None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:45.033593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a9e54-43f4-4120-963c-69d4c6423e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:45.033593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a9e54-43f4-4120-963c-69d4c6423e53 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:45.033593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a9e54-43f4-4120-963c-69d4c6423e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:45.033593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a9e54-43f4-4120-963c-69d4c6423e53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:45.044222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a9e54-43f4-4120-963c-69d4c6423e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-109a9e54-43f4-4120-963c-69d4c6423e53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:36:45.052505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:45.053503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:45.054454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 609/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:36:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:45.061110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be354c8-e349-4e82-b5c2-4ad6b3631eff None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:45.109316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:45.169077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be354c8-e349-4e82-b5c2-4ad6b3631eff None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:45.204262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:45.204935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:45.205217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:45.205491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:45.206272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:45.206576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:45.207955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:45.217066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 600/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:45.222765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a9e54-43f4-4120-963c-69d4c6423e53 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:45.273115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:45.322632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a9e54-43f4-4120-963c-69d4c6423e53 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:45.358230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:45.359024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:45.359308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:45.359583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:45.369552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:45.371027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:45.388783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:45.392274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:45.393435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:45.393435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:45.393435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:45.393435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:45.393435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 610/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:45.395729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:45.496959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:45.500366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f990889-d99f-4cb9-9f81-d0481a387d6c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:45.535553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:45.536213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:45.536498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:45.536773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:45.537539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:45.537844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:45.539235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:45.550342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 601/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:45.556005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:45.668530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0be00d-1029-483a-9128-a12120a718e1 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:45.670164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:45.702762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:45.703552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:45.703832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:45.704109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:45.710924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:45.712337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:36:45.727563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:45.728824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:45.730040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 611/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:45.734660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:45.832489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e19cf-43c6-4cd2-aea2-aa6bb48afc1a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:45.866668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:45.867336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:45.867621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:45.867897 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:45.868830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:45.869150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:45.870632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:45.888258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 602/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jul 11 14:36:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:45.894049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:45.993240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a5b42-5045-4e56-b555-592b509951c4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:46.026247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68c842-17e0-4082-bb3b-dd467f30ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:46.026889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c842-17e0-4082-bb3b-dd467f30ea9b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:46.027175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c842-17e0-4082-bb3b-dd467f30ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:46.027452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c842-17e0-4082-bb3b-dd467f30ea9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:46.058722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:46.096267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68c842-17e0-4082-bb3b-dd467f30ea9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:46.097715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68c842-17e0-4082-bb3b-dd467f30ea9b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:46.195858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 612/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:36:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:36:46.201622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:46.220670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:46.299518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e71d2-9482-47e7-a491-9fa957249aac None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:46.333955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:46.334772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:46.335053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:46.335328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:46.346915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:46.348488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:46.365593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:46.366730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:46.368059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:46.368059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:46.368059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:46.368059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:46.368059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 603/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:46.372514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68c842-17e0-4082-bb3b-dd467f30ea9b None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:46.433550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:46.472002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68c842-17e0-4082-bb3b-dd467f30ea9b None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:46.506440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:46.507111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:46.507400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:46.507684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:46.508639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:46.509235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:46.511378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:46.524316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 613/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:46.531023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:46.601755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:46.632232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7050491-8fb3-4fc5-92d0-c41c3436fd75 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:46.665386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:46.666201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:46.666483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:46.666758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:46.674324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:46.679172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:36:46.690406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:46.691500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:46.692511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 604/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:36:46.697366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:46.800079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eec823-722c-4b25-aa3f-fc716ca9f223 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:46.822801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:46.834750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2276eb-8eb6-4b33-b2b2-862039fc2107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:46.835408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2276eb-8eb6-4b33-b2b2-862039fc2107 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:46.835721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2276eb-8eb6-4b33-b2b2-862039fc2107 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:46.835976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2276eb-8eb6-4b33-b2b2-862039fc2107 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:46.836759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2276eb-8eb6-4b33-b2b2-862039fc2107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:46.837072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2276eb-8eb6-4b33-b2b2-862039fc2107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:46.838540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2276eb-8eb6-4b33-b2b2-862039fc2107 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:46.852660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 614/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:46.857719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:46.966889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1e283-6a74-49ff-9b3c-39a6e1336fa3 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:46.994690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:47.000991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20680ef-b3cb-40c0-9b80-f95be3cc3e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:47.001643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20680ef-b3cb-40c0-9b80-f95be3cc3e5f None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:47.001924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20680ef-b3cb-40c0-9b80-f95be3cc3e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:47.002228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20680ef-b3cb-40c0-9b80-f95be3cc3e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:47.003053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20680ef-b3cb-40c0-9b80-f95be3cc3e5f None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=db2728bb6856484b853191e75fa49f93) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:47.003368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20680ef-b3cb-40c0-9b80-f95be3cc3e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:47.004802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20680ef-b3cb-40c0-9b80-f95be3cc3e5f None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:47.010119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 605/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:36:46 2022] GET /identity/v3/role_assignments?user.id=db2728bb6856484b853191e75fa49f93&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:49.025031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd5d5-3fb2-4eb5-8d58-77dbdaa5a689 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.025550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd5d5-3fb2-4eb5-8d58-77dbdaa5a689 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.025550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd5d5-3fb2-4eb5-8d58-77dbdaa5a689 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.026910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 615/1220] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:49.032618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e8651-4176-4167-bbc8-1e940a88fe51 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.033053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e8651-4176-4167-bbc8-1e940a88fe51 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.033157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e8651-4176-4167-bbc8-1e940a88fe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.050536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a65e8651-4176-4167-bbc8-1e940a88fe51 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:49.051710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a65e8651-4176-4167-bbc8-1e940a88fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:49.117083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 606/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:36:49.140456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd5d5-3fb2-4eb5-8d58-77dbdaa5a689 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.241755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd5d5-3fb2-4eb5-8d58-77dbdaa5a689 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.275918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25986fd4-80fa-4b2f-9071-b3c96950c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.276642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986fd4-80fa-4b2f-9071-b3c96950c956 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.276928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986fd4-80fa-4b2f-9071-b3c96950c956 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.277203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986fd4-80fa-4b2f-9071-b3c96950c956 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.287486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25986fd4-80fa-4b2f-9071-b3c96950c956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-25986fd4-80fa-4b2f-9071-b3c96950c956 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:36:49.295763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:49.297042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:49.298249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 616/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:49.303184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e8651-4176-4167-bbc8-1e940a88fe51 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.402541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e8651-4176-4167-bbc8-1e940a88fe51 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.425648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:49.436591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.437254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.437538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.437817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.438600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:49.438914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.440284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:49.448318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 607/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:49.454339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25986fd4-80fa-4b2f-9071-b3c96950c956 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.497394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:49.554471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25986fd4-80fa-4b2f-9071-b3c96950c956 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.586936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.587770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.588053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.588327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.598456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.599875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:49.617882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:49.624261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:49.625386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:49.625386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:49.625386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:49.625386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:49.625386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 617/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:36:49.625843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.724459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff41d-d7a0-455b-94fe-a3c1e20c01f1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.757798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.758486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.758783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.759042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.759752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:49.760057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.761403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:49.773630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 608/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:49.780274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.876016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:49.882504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16690f-f4f7-46e7-be32-1220670b6af1 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.916484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.917281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.917563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.917838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.926043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.927494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:36:49.941319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:49.943335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:49.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 618/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:49.948624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.995787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:50.048460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c66bbf-1a37-4f74-960f-012753d3f83a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:50.082268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:50.082924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.083208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.083485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.084309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:50.084621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:50.086089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:50.103881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 609/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:36:50.109604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:50.208329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9f435-01bc-4d09-9559-20d071182307 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:50.241241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:50.242021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.242340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.242624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.253094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:50.254569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:50.272097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:50.273151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:50.274384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:50.274384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:50.274384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:50.274384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:50.274384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 619/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:50.279083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:50.377796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdfccc-48a3-4021-a5e1-911075092b59 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:50.380385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:50.412336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:50.413001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.413288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.413565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.414303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:50.414612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:50.415968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:50.427334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 610/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:50.433033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:50.443603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:50.534477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977b73-b9e8-450d-8a6d-de892e728aec None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:50.568526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:50.569313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.569601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.569882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.577408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:50.578873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:36:50.593036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:50.594205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:50.595546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 620/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:50.600401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:50.704467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b92e0-c49d-4ff8-9d22-142d269a6852 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:50.737271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad08a84-8a1e-4516-a5b6-a1be660b58e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:50.737929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08a84-8a1e-4516-a5b6-a1be660b58e3 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.738254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08a84-8a1e-4516-a5b6-a1be660b58e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.738537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08a84-8a1e-4516-a5b6-a1be660b58e3 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.739326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08a84-8a1e-4516-a5b6-a1be660b58e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:50.739640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08a84-8a1e-4516-a5b6-a1be660b58e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:50.743264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08a84-8a1e-4516-a5b6-a1be660b58e3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:50.754961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 611/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:50.761028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:50.829227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:50.864237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40b29-3bcf-4f0a-b0ce-f438cf19b5a6 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:50.899536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b73bb0-f774-4a2b-b6fb-a1206b84f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:50.900409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b73bb0-f774-4a2b-b6fb-a1206b84f989 None admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.900691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b73bb0-f774-4a2b-b6fb-a1206b84f989 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.900964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b73bb0-f774-4a2b-b6fb-a1206b84f989 None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/db2728bb6856484b853191e75fa49f93/roles/af9f77c3be4c47969788085eedea854d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.915745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b73bb0-f774-4a2b-b6fb-a1206b84f989 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=db2728bb6856484b853191e75fa49f93, role_id=af9f77c3be4c47969788085eedea854d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:50.917177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b73bb0-f774-4a2b-b6fb-a1206b84f989 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:51.024212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 621/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:36:50 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/db2728bb6856484b853191e75fa49f93/roles/af9f77c3be4c47969788085eedea854d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:36:53.041571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5004-f930-46d4-9fca-bc5f62798938 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:53.042086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5004-f930-46d4-9fca-bc5f62798938 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:53.042086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5004-f930-46d4-9fca-bc5f62798938 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:53.043425 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 612/1233] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:53.048607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7cbcc-561b-459a-9265-5c5992628276 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:53.049023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7cbcc-561b-459a-9265-5c5992628276 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:53.049175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7cbcc-561b-459a-9265-5c5992628276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:53.065423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d1a7cbcc-561b-459a-9265-5c5992628276 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:53.066872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d1a7cbcc-561b-459a-9265-5c5992628276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:53.133383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 622/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:36:53.158221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab5004-f930-46d4-9fca-bc5f62798938 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:53.183228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:53.257299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab5004-f930-46d4-9fca-bc5f62798938 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:53.292342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299a93-c3d0-447b-b106-1f9cda2b37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:53.293060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299a93-c3d0-447b-b106-1f9cda2b37ea None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:53.293343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299a93-c3d0-447b-b106-1f9cda2b37ea None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:53.293616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299a93-c3d0-447b-b106-1f9cda2b37ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:53.303661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32299a93-c3d0-447b-b106-1f9cda2b37ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-32299a93-c3d0-447b-b106-1f9cda2b37ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:36:53.311562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:53.312721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:53.313711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 613/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Jul 11 14:36:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:53.318820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7cbcc-561b-459a-9265-5c5992628276 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:53.365759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:53.420749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7cbcc-561b-459a-9265-5c5992628276 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:53.455038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:53.455849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:53.456132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:53.456409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:53.457149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] RBAC: Adding query filter params (name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:53.457456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:53.458841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:53.467052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 623/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Jul 11 14:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:53.472744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299a93-c3d0-447b-b106-1f9cda2b37ea None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:53.557797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:53.573568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299a93-c3d0-447b-b106-1f9cda2b37ea None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:53.607379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:53.608168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:53.608454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:53.608732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:53.618545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:53.619979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:53.639236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:53.640390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:53.641556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:53.641556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:53.641556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:53.641556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:53.641556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 614/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:53.646135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:53.746910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fb82e-2ff9-45d2-ba86-b2364cac3d80 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:53.756815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:53.781246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:53.781900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:53.782211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:53.782486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:53.783193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:53.783503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:53.784845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:53.796544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 624/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:53.802241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:53.910951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1ce00-91e9-4ac9-a44d-69f4740414cc None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:53.946053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:53.946892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:53.947177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:53.947479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:53.950173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:53.955287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:53.956734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:36:53.971776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:53.973314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:53.974705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 615/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:53.979739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:54.083628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14872ca-2d9c-41cb-bc87-719395776c33 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:54.121109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:54.122272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:54.123291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:54.123771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:54.125341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:54.125875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:54.128606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:54.148731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 625/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jul 11 14:36:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:54.155070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:54.253997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8d29-5a69-490f-99e0-617546b81523 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:54.287609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dae99-d6d5-4606-9323-d50bdd74dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:54.288250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dae99-d6d5-4606-9323-d50bdd74dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:54.288539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dae99-d6d5-4606-9323-d50bdd74dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:54.288817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dae99-d6d5-4606-9323-d50bdd74dfa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:54.349386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:54.355856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170dae99-d6d5-4606-9323-d50bdd74dfa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:54.357327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170dae99-d6d5-4606-9323-d50bdd74dfa1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:54.461583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 616/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:36:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:36:54.467635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:54.494151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:54.569791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d55cdf-e5f2-4a56-a7f5-c9798d528ab4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:54.602649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:54.603434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:54.603720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:54.604000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:54.614556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:54.616056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:54.633833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:54.635006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:54.636123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:54.636123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:54.636123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:54.636123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:54.636123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 626/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:54.641236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dae99-d6d5-4606-9323-d50bdd74dfa1 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:54.735518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:54.741542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dae99-d6d5-4606-9323-d50bdd74dfa1 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:54.776133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:54.776793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:54.777130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:54.777413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:54.778155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:54.778472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:54.779896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:54.791171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 617/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:54.797301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:54.877711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:54.898698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03242676-0c8e-4048-a56a-ea23d7e7a808 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:54.932912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:54.933709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:54.933996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:54.934312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:54.940887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:54.942404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:36:54.956846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:54.958649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:54.960550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 627/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:54.963718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:55.063712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c3da0-1bd9-4a19-8e2a-6a14c8ec7b52 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:55.096741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfbab8-b2ee-4c13-ae06-a119c2142659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:55.097463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfbab8-b2ee-4c13-ae06-a119c2142659 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:55.097752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfbab8-b2ee-4c13-ae06-a119c2142659 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:55.098030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfbab8-b2ee-4c13-ae06-a119c2142659 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:55.098851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfbab8-b2ee-4c13-ae06-a119c2142659 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:55.099169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfbab8-b2ee-4c13-ae06-a119c2142659 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:55.100598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfbab8-b2ee-4c13-ae06-a119c2142659 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:55.112877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 618/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:55.118932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:55.215737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c2b22-034e-4c3f-a37a-e894f72d1f28 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:55.250191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcdd81-f4f4-4ffa-82f7-6764bca450df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:55.250837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdd81-f4f4-4ffa-82f7-6764bca450df None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:55.251114 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdd81-f4f4-4ffa-82f7-6764bca450df None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:55.251387 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdd81-f4f4-4ffa-82f7-6764bca450df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:55.252205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcdd81-f4f4-4ffa-82f7-6764bca450df None admin] RBAC: Adding query filter params (role.id=af9f77c3be4c47969788085eedea854d, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=db2728bb6856484b853191e75fa49f93) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:55.252515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcdd81-f4f4-4ffa-82f7-6764bca450df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:55.253932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcdd81-f4f4-4ffa-82f7-6764bca450df None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:55.259748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 628/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:36:55 2022] GET /identity/v3/role_assignments?user.id=db2728bb6856484b853191e75fa49f93&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=af9f77c3be4c47969788085eedea854d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:57.333951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4deb24-8e47-4a1a-a6a1-ec5baec18b1e None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:57.334534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4deb24-8e47-4a1a-a6a1-ec5baec18b1e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:57.334534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4deb24-8e47-4a1a-a6a1-ec5baec18b1e None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:57.335891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 619/1247] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:57.340928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef336d-6894-462e-b43c-7416004c0da8 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:57.341341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef336d-6894-462e-b43c-7416004c0da8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:57.342056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef336d-6894-462e-b43c-7416004c0da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:57.347146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:57.359836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9bef336d-6894-462e-b43c-7416004c0da8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:57.361037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9bef336d-6894-462e-b43c-7416004c0da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:57.426841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 629/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:36:57.450775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4deb24-8e47-4a1a-a6a1-ec5baec18b1e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:57.469436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:57.553675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4deb24-8e47-4a1a-a6a1-ec5baec18b1e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:57.588462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be2efc-933e-4df5-9bd7-899275559c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:57.589194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be2efc-933e-4df5-9bd7-899275559c4d None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:57.589456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be2efc-933e-4df5-9bd7-899275559c4d None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:57.589730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be2efc-933e-4df5-9bd7-899275559c4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:57.600316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be2efc-933e-4df5-9bd7-899275559c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-41be2efc-933e-4df5-9bd7-899275559c4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:36:57.607879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:57.609002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:57.610053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 620/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:36:57.615349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef336d-6894-462e-b43c-7416004c0da8 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:57.714902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef336d-6894-462e-b43c-7416004c0da8 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:57.746315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:57.751229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:57.751901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:57.752183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:57.753279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:57.753279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:57.753489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:57.754884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:57.763811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 630/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:57.769533 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be2efc-933e-4df5-9bd7-899275559c4d None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:57.845050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:57.867134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be2efc-933e-4df5-9bd7-899275559c4d None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:57.900929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:57.901760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:57.902047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:57.902354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:57.916653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:57.919473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:57.952840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:57.953968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:57.959198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:57.959198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:57.959198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:57.959198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:57.959198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 621/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:57.960754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:58.059393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09398cbe-54fa-46ed-971d-06c14252b3cf None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:58.093030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:58.093692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:58.093976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:58.094284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:58.095000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:58.095354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:58.096661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:58.108066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 631/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:58.113881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:58.214348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d280e8-807c-4522-af17-c5d125fc45d8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:58.239936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:58.247534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:58.248836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:58.249122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:58.249400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:58.256883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:58.261411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:36:58.273482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:58.274700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:36:58.276084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 622/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:58.280720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:58.336796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:58.383166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a7770-2780-43b3-9815-cc002e4565dd None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:58.416947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:58.417609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:58.417891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:58.418311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:58.419142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:58.419451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:58.421597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:58.440909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 632/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jul 11 14:36:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:36:58.446799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:58.547890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b290ec-f16d-4f37-8215-ba8225947747 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:58.583153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb897e-b498-4a33-b463-9b70ac7b5988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:58.583804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb897e-b498-4a33-b463-9b70ac7b5988 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:58.584087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb897e-b498-4a33-b463-9b70ac7b5988 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:58.584365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb897e-b498-4a33-b463-9b70ac7b5988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:58.640058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:58.652600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb897e-b498-4a33-b463-9b70ac7b5988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:58.654604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb897e-b498-4a33-b463-9b70ac7b5988 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:58.757817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 623/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:36:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:36:58.764212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:58.866800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524883c2-661b-4fb4-b715-cd3dc90c5764 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:58.880872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:58.902595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:58.903338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:58.903634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:58.904404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:58.914753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:58.916196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:36:58.935223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:58.936369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:58.937417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:36:58.937417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:36:58.937417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:36:58.937417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:58.937417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 633/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:58.942312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb897e-b498-4a33-b463-9b70ac7b5988 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:59.031256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:59.043908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb897e-b498-4a33-b463-9b70ac7b5988 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:59.077486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:59.078169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:59.078484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:59.078761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:59.079470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:59.079778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:59.081134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:59.092678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 624/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:59.098551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:59.208177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba1145-6cd8-4373-8467-30d2e1d151a2 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:59.249779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:59.250605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:59.250892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:59.251173 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:59.257824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:59.259291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:36:59.273775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:36:59.274892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:36:59.276049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 634/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:36:59.281984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:59.389194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9ce6-ce7a-4915-b83d-a50b32ba0e1a None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:59.423036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9267-7326-462e-86ff-5c0786a47d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:59.423690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9267-7326-462e-86ff-5c0786a47d76 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:59.423970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9267-7326-462e-86ff-5c0786a47d76 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:59.424243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9267-7326-462e-86ff-5c0786a47d76 None admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:59.425021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d9267-7326-462e-86ff-5c0786a47d76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:59.425330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d9267-7326-462e-86ff-5c0786a47d76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:59.426783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d9267-7326-462e-86ff-5c0786a47d76 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:59.439724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 625/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:59.446040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:59.475081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:59.559527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d090fba-fb52-450d-947b-e4e305f7a3d5 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:59.594688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4c29-82cc-4b7d-a3a5-e28d5a3e424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:59.595342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4c29-82cc-4b7d-a3a5-e28d5a3e424b None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:59.595625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4c29-82cc-4b7d-a3a5-e28d5a3e424b None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:59.595903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4c29-82cc-4b7d-a3a5-e28d5a3e424b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:59.596727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4c29-82cc-4b7d-a3a5-e28d5a3e424b None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=db2728bb6856484b853191e75fa49f93) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:59.597035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4c29-82cc-4b7d-a3a5-e28d5a3e424b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:59.598513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4c29-82cc-4b7d-a3a5-e28d5a3e424b None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:59.604039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 635/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:36:59 2022] GET /identity/v3/role_assignments?user.id=db2728bb6856484b853191e75fa49f93&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:01.644001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b3c15-ae8d-4643-ae04-3972b08aed3b None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:01.644558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b3c15-ae8d-4643-ae04-3972b08aed3b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:01.644558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b3c15-ae8d-4643-ae04-3972b08aed3b None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:01.645953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 626/1261] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:01.651750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d0db-25d2-43b4-8eee-e541a5d28a7d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:01.652178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d0db-25d2-43b4-8eee-e541a5d28a7d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:01.652314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d0db-25d2-43b4-8eee-e541a5d28a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:01.668952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b278d0db-25d2-43b4-8eee-e541a5d28a7d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:01.670197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b278d0db-25d2-43b4-8eee-e541a5d28a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:01.742474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 636/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:37:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:37:01.765998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b3c15-ae8d-4643-ae04-3972b08aed3b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:01.776987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:01.873501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b3c15-ae8d-4643-ae04-3972b08aed3b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:01.908763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cde4c-c70a-4591-9d04-41c37ef9b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:01.909490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cde4c-c70a-4591-9d04-41c37ef9b84e None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:01.909779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cde4c-c70a-4591-9d04-41c37ef9b84e None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:01.910057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cde4c-c70a-4591-9d04-41c37ef9b84e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:01.920379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cde4c-c70a-4591-9d04-41c37ef9b84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-ec6cde4c-c70a-4591-9d04-41c37ef9b84e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:37:01.928073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:01.930724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:37:01.931802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 627/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:01.935977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278d0db-25d2-43b4-8eee-e541a5d28a7d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:01.955990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:02.034420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278d0db-25d2-43b4-8eee-e541a5d28a7d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:02.068598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:02.069402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.069622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.069899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.070674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:02.070985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:02.072361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:02.080604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 637/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:02.086480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cde4c-c70a-4591-9d04-41c37ef9b84e None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:02.153583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:02.187619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cde4c-c70a-4591-9d04-41c37ef9b84e None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:02.219685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:02.220469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.220752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.221096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.232660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:02.234157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:37:02.251834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:02.253102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:02.254234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:37:02.254234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:37:02.254234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:37:02.254234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:37:02.254234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 628/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:02.259116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:02.340475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:02.359671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6d022-0515-487f-8caf-9c129de57877 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:02.393415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:02.394144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.394432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.394708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.395434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:02.395745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:02.397103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:02.410376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 638/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:02.416210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:02.517871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8924a53-40f2-4373-ae4f-975577e73a2c None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:02.537026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:02.551564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:02.552358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.552639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.552912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.560225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:02.561647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:37:02.575568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:02.576663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:37:02.578130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 629/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:37:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:02.582891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:02.685091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a518dd5-50e6-496b-bd3e-0fd16bd174ea None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:02.718639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:02.719312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.719592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.719869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.720701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:02.721015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:02.722461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:02.733248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:02.748833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 639/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jul 11 14:37:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:02.754664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:02.855931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beb6fd-1846-421f-ac3d-c312f7aa8804 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:02.890938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:02.891869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.892166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.892460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.903452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:02.904954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:37:02.923258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:02.924464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:02.925825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:37:02.925825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:37:02.925825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:37:02.925825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:37:02.925825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 630/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:02.930390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:03.031780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434b820-a511-48d4-8d19-841072de45ec None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:03.066461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:03.067121 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:03.067397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:03.067672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:03.068388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:03.068687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:03.070057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:03.082609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 640/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:03.088494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:03.120805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:03.193132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a526b4-9fc0-4c04-9f2d-fbc2188f39c2 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:03.227100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:03.227885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:03.228171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:03.228449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:03.235839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:03.237268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:37:03.251200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:03.252300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:37:03.253429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 631/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:03.258503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:03.317542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:03.359445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c16b-ad55-42f2-b316-d647135a69c1 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:03.394392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1f5f-70be-44fe-81db-795c3d89f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:03.394995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1f5f-70be-44fe-81db-795c3d89f742 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:03.395266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1f5f-70be-44fe-81db-795c3d89f742 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:03.395540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1f5f-70be-44fe-81db-795c3d89f742 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:03.396320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1f5f-70be-44fe-81db-795c3d89f742 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:03.396630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1f5f-70be-44fe-81db-795c3d89f742 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:03.398040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1f5f-70be-44fe-81db-795c3d89f742 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:03.410796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 641/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:03.417023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:03.508639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:03.518836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f67b-f7d2-4792-937c-59813ea750c8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:03.554901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded27d59-aa7e-4a8a-8b95-ee32934c60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:03.555766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27d59-aa7e-4a8a-8b95-ee32934c60f1 None admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:03.556050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27d59-aa7e-4a8a-8b95-ee32934c60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:03.556330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27d59-aa7e-4a8a-8b95-ee32934c60f1 None admin] PATH_INFO: `/v3/projects/24e01825c6f345739df1926c594ccb50/users/db2728bb6856484b853191e75fa49f93/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:03.558305 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded27d59-aa7e-4a8a-8b95-ee32934c60f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e01825c6f345739df1926c594ccb50, user_id=db2728bb6856484b853191e75fa49f93, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:03.559727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded27d59-aa7e-4a8a-8b95-ee32934c60f1 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:03.681750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 632/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Jul 11 14:37:03 2022] PUT /identity/v3/projects/24e01825c6f345739df1926c594ccb50/users/db2728bb6856484b853191e75fa49f93/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:37:05.708901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77104364-c520-46ab-8f22-1166da0d67a8 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:05.709499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77104364-c520-46ab-8f22-1166da0d67a8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:05.709499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77104364-c520-46ab-8f22-1166da0d67a8 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:05.710881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 642/1274] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:05.716102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843ce00-bc32-49b7-b2f1-beac8b1289de None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:05.716517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843ce00-bc32-49b7-b2f1-beac8b1289de None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:05.716739 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843ce00-bc32-49b7-b2f1-beac8b1289de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:05.733895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9843ce00-bc32-49b7-b2f1-beac8b1289de None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:05.735159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9843ce00-bc32-49b7-b2f1-beac8b1289de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:05.817785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 633/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:37:05.846030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77104364-c520-46ab-8f22-1166da0d67a8 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:05.951070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77104364-c520-46ab-8f22-1166da0d67a8 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:05.971332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:05.989015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94cc49-f302-41c8-8e45-dd346d4941e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:05.993831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94cc49-f302-41c8-8e45-dd346d4941e4 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:05.993831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94cc49-f302-41c8-8e45-dd346d4941e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:05.993831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94cc49-f302-41c8-8e45-dd346d4941e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.000858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94cc49-f302-41c8-8e45-dd346d4941e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-fa94cc49-f302-41c8-8e45-dd346d4941e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:37:06.008343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:06.009548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:06.010716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 643/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Jul 11 14:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:06.017513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843ce00-bc32-49b7-b2f1-beac8b1289de None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:06.102489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:06.120558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843ce00-bc32-49b7-b2f1-beac8b1289de None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:06.155062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:06.155728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.156012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.156286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.157022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:06.157329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:06.158719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:06.166720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 634/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Jul 11 14:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:06.173216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94cc49-f302-41c8-8e45-dd346d4941e4 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:06.275985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94cc49-f302-41c8-8e45-dd346d4941e4 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:06.310140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:06.310974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.311289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.311579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.322149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:06.323591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:37:06.340683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:06.342345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:06.343367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:37:06.343367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:37:06.343367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:37:06.343367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:06.343367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 644/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:06.348346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:06.447681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f1886-be97-4afe-8ae1-dfbd47730421 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:06.487047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:06.487705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.488011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.488286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.488993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:06.489295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:06.490691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:06.502465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 635/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:06.508394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:06.541254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:06.612815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5354cfa-4e9d-4084-9a8b-db5bca7671b3 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:06.647499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:06.648290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.648574 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.648851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.657048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:06.659009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:37:06.673403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:06.674631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:06.675807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 645/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:37:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:06.680670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:06.684655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:06.782563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a475cf5-73d6-4b74-becd-8858a770c3a4 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:06.815921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:06.816602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.816888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.817165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.818002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:06.818347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:06.819778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:06.837959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 636/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jul 11 14:37:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:06.844309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:06.936782 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:06.946218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca82ae-eb6a-4c21-b3de-058c782bdac0 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:06.980611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcd83f-d340-44c6-936a-51ca4e641c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:06.981271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcd83f-d340-44c6-936a-51ca4e641c3c None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.981559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcd83f-d340-44c6-936a-51ca4e641c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.981836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcd83f-d340-44c6-936a-51ca4e641c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:07.051565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcd83f-d340-44c6-936a-51ca4e641c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:07.053004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcd83f-d340-44c6-936a-51ca4e641c3c None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:07.142910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:07.153025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 646/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Jul 11 14:37:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:37:07.161907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:07.230632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:07.271703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6dcc-c7ff-4979-94bf-5f387b3b3c60 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:07.304992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:07.305786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:07.306065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:07.306378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:07.316635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:07.318091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:37:07.335280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:07.336437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:07.337614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:37:07.337614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:37:07.337614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:37:07.337614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:37:07.337614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 637/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:07.343136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcd83f-d340-44c6-936a-51ca4e641c3c None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:07.448038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcd83f-d340-44c6-936a-51ca4e641c3c None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:07.484730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:07.485466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:07.485754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:07.486033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:07.486788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:07.487098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:07.488556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:07.500036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 647/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Jul 11 14:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:07.505910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:07.608406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7e49b-5dd8-44e1-a69c-3d8e0da409dc None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:07.622283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:07.643240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:07.644097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:07.644375 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:07.644669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:07.651325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:07.652756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:37:07.666937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:07.673179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: ERROR keystone.server.flask.application Jul 11 14:37:07.674197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 638/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Jul 11 14:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:07.674735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:07.726483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:07.778455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f574f-0381-4eae-85af-9f50438f0087 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:07.812644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638dfd3-ed3d-4073-b6d4-bc528ca96279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:07.813303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638dfd3-ed3d-4073-b6d4-bc528ca96279 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:07.813581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638dfd3-ed3d-4073-b6d4-bc528ca96279 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:07.813863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638dfd3-ed3d-4073-b6d4-bc528ca96279 None admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:07.814680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638dfd3-ed3d-4073-b6d4-bc528ca96279 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:07.814991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638dfd3-ed3d-4073-b6d4-bc528ca96279 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:07.816407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638dfd3-ed3d-4073-b6d4-bc528ca96279 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:07.828762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 648/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Jul 11 14:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:07.834981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:07.937663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c47bd-c9ce-4215-aa2b-d20c74073fa8 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:07.972083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865d3d-c9d1-482f-991d-f17d9db00e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:07.972733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865d3d-c9d1-482f-991d-f17d9db00e38 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:07.973018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865d3d-c9d1-482f-991d-f17d9db00e38 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:07.973289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865d3d-c9d1-482f-991d-f17d9db00e38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:07.974128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865d3d-c9d1-482f-991d-f17d9db00e38 None admin] RBAC: Adding query filter params (role.id=aa5917344d8b4ee78bcb09ec5cb6c179, scope.project.id=24e01825c6f345739df1926c594ccb50, user.id=db2728bb6856484b853191e75fa49f93) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:07.974454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865d3d-c9d1-482f-991d-f17d9db00e38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:07.975878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865d3d-c9d1-482f-991d-f17d9db00e38 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:07.981738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 639/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Jul 11 14:37:07 2022] GET /identity/v3/role_assignments?user.id=db2728bb6856484b853191e75fa49f93&scope.project.id=24e01825c6f345739df1926c594ccb50&role.id=aa5917344d8b4ee78bcb09ec5cb6c179 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:10.096481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d6e9-ab9e-4d07-bc70-af34d953ab25 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:10.096481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d6e9-ab9e-4d07-bc70-af34d953ab25 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:10.098146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d6e9-ab9e-4d07-bc70-af34d953ab25 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:10.098736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 649/1288] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:10.104208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d3f53-f9df-4871-88ec-5c53680478f1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:10.104885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d3f53-f9df-4871-88ec-5c53680478f1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:10.104885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d3f53-f9df-4871-88ec-5c53680478f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:10.123473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a24d3f53-f9df-4871-88ec-5c53680478f1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:10.124733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a24d3f53-f9df-4871-88ec-5c53680478f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:10.157893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:10.199105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 640/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:37:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:37:10.222686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d6e9-ab9e-4d07-bc70-af34d953ab25 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:10.349524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d6e9-ab9e-4d07-bc70-af34d953ab25 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:10.362058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:10.390892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:10.392058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:10.392438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:10.392872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:10.393948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:10.396479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:10.427678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:10.429116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:10.430292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 650/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:37:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:10.436016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d3f53-f9df-4871-88ec-5c53680478f1 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:10.551251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d3f53-f9df-4871-88ec-5c53680478f1 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:10.591381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfff088-1888-4f15-b490-e7f432fa46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:10.592047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff088-1888-4f15-b490-e7f432fa46fe None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:10.592328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff088-1888-4f15-b490-e7f432fa46fe None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:10.592606 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff088-1888-4f15-b490-e7f432fa46fe None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:10.593312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfff088-1888-4f15-b490-e7f432fa46fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:10.593672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfff088-1888-4f15-b490-e7f432fa46fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:10.595064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfff088-1888-4f15-b490-e7f432fa46fe None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:10.606024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 641/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Jul 11 14:37:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:10.606217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:10.709851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589d709-a1c3-4742-af6e-5b8b4892d87a None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:10.747385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b702d2-bf18-492e-bfdc-30b8914df9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:10.748464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b702d2-bf18-492e-bfdc-30b8914df9f1 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:10.748753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b702d2-bf18-492e-bfdc-30b8914df9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:10.749037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b702d2-bf18-492e-bfdc-30b8914df9f1 None admin] PATH_INFO: `/v3/services` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:10.749807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b702d2-bf18-492e-bfdc-30b8914df9f1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:10.750148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b702d2-bf18-492e-bfdc-30b8914df9f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:10.751534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b702d2-bf18-492e-bfdc-30b8914df9f1 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:10.756909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 651/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Jul 11 14:37:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:12.792276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f6ea-804e-4932-8a09-dd6c1bd1f0fc None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:12.792796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f6ea-804e-4932-8a09-dd6c1bd1f0fc None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:12.792796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f6ea-804e-4932-8a09-dd6c1bd1f0fc None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:12.794194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 642/1293] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:12.800312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb87af-f96e-4348-9f00-e735c9a8db62 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:12.800719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb87af-f96e-4348-9f00-e735c9a8db62 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:12.800866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb87af-f96e-4348-9f00-e735c9a8db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:12.818013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f4eb87af-f96e-4348-9f00-e735c9a8db62 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:12.819217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f4eb87af-f96e-4348-9f00-e735c9a8db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:12.848668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:12.886281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 652/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:37:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:37:12.909878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f6ea-804e-4932-8a09-dd6c1bd1f0fc None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:12.941890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:13.013813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f6ea-804e-4932-8a09-dd6c1bd1f0fc None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:13.048474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4b43e-79a9-4200-ac04-80b8d562c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:13.049133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4b43e-79a9-4200-ac04-80b8d562c9a3 None admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:13.049420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4b43e-79a9-4200-ac04-80b8d562c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:13.049702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4b43e-79a9-4200-ac04-80b8d562c9a3 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:13.050477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4b43e-79a9-4200-ac04-80b8d562c9a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:13.051847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4b43e-79a9-4200-ac04-80b8d562c9a3 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:13.115865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 643/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Jul 11 14:37:12 2022] POST /identity/v3/services => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:37:15.163117 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989ea1f-396e-433b-aa6c-5e8438dd35ad None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.163644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989ea1f-396e-433b-aa6c-5e8438dd35ad None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.163760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989ea1f-396e-433b-aa6c-5e8438dd35ad None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.165092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 653/1296] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:15.170549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643eadd-ae77-45a7-ba07-6d4879c69dd7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.171099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643eadd-ae77-45a7-ba07-6d4879c69dd7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.171099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643eadd-ae77-45a7-ba07-6d4879c69dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.188199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4643eadd-ae77-45a7-ba07-6d4879c69dd7 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:15.189390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4643eadd-ae77-45a7-ba07-6d4879c69dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:15.261203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 644/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:37:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:37:15.285321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989ea1f-396e-433b-aa6c-5e8438dd35ad None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:15.385128 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989ea1f-396e-433b-aa6c-5e8438dd35ad None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:15.420104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:15.420941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.421225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.421502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.422174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:15.423537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:15.435868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:15.437106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:15.438327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 654/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:37:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:15.443451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643eadd-ae77-45a7-ba07-6d4879c69dd7 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:15.462066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:15.541999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643eadd-ae77-45a7-ba07-6d4879c69dd7 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:15.578025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:15.578725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.579005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.579277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.580001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:15.580306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:15.581699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:15.586839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 645/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Jul 11 14:37:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:15.592786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:15.625208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:15.696736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9249ba-691f-4dcd-a956-7e7bfbfa8dd9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:15.731091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239d1c9-5ce7-4339-bfb3-0ed12fbb0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:15.737551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d1c9-5ce7-4339-bfb3-0ed12fbb0864 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.737551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d1c9-5ce7-4339-bfb3-0ed12fbb0864 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.737551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d1c9-5ce7-4339-bfb3-0ed12fbb0864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.737551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239d1c9-5ce7-4339-bfb3-0ed12fbb0864 None admin] RBAC: Adding query filter params (interface=public, service_id=6972f13024af41b6918d9d52ba01a52f, region_id=RegionOne) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:15.737551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239d1c9-5ce7-4339-bfb3-0ed12fbb0864 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:15.737551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239d1c9-5ce7-4339-bfb3-0ed12fbb0864 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:15.741327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 655/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Jul 11 14:37:15 2022] GET /identity/v3/endpoints?service_id=6972f13024af41b6918d9d52ba01a52f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:15.747466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:15.830364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:15.848495 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329852a-763a-4ca1-8d42-3648363758f0 None admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:15.882184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a95d-e256-4159-abea-dc887fe8a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:15.882844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a95d-e256-4159-abea-dc887fe8a18b None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.883126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a95d-e256-4159-abea-dc887fe8a18b None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.883398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a95d-e256-4159-abea-dc887fe8a18b None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.884090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a95d-e256-4159-abea-dc887fe8a18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:15.885470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a95d-e256-4159-abea-dc887fe8a18b None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:15.892984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 646/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Jul 11 14:37:15 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:37:17.901764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fda48f-5a65-4496-99c9-2ae28559191d None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:17.901764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fda48f-5a65-4496-99c9-2ae28559191d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:17.902392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fda48f-5a65-4496-99c9-2ae28559191d None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:17.903340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 656/1302] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:17.909062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34167e7-23f0-4c77-a573-6fe2c663ed5b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:17.909508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34167e7-23f0-4c77-a573-6fe2c663ed5b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:17.909646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34167e7-23f0-4c77-a573-6fe2c663ed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:17.926440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b34167e7-23f0-4c77-a573-6fe2c663ed5b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:17.927624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b34167e7-23f0-4c77-a573-6fe2c663ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:17.994946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 647/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:37:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:37:18.019205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fda48f-5a65-4496-99c9-2ae28559191d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:18.117200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:18.124352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fda48f-5a65-4496-99c9-2ae28559191d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:18.160210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:18.161007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:18.161290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:18.161567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:18.162443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:18.163837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:37:18.175871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:37:18.176980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application with Lock( Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: ERROR keystone.server.flask.application Jul 11 14:37:18.178241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 657/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jul 11 14:37:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:37:18.183448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34167e7-23f0-4c77-a573-6fe2c663ed5b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:18.260626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:18.283393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34167e7-23f0-4c77-a573-6fe2c663ed5b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:18.321867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b414-92b7-499e-8d1e-144057305803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:18.322623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b414-92b7-499e-8d1e-144057305803 None admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:18.323120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b414-92b7-499e-8d1e-144057305803 None admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:18.323418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b414-92b7-499e-8d1e-144057305803 None admin] PATH_INFO: `/v3/services` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:18.324208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b414-92b7-499e-8d1e-144057305803 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:37:18.325005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b414-92b7-499e-8d1e-144057305803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:18.326945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b414-92b7-499e-8d1e-144057305803 None admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:18.332245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 648/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Jul 11 14:37:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:18.338226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:18.461739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201545-c76c-4724-9d2a-ee1206d8b6a9 None admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:18.500861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f5603-6d31-4632-9b79-4bb56a7f5fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:18.501516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5603-6d31-4632-9b79-4bb56a7f5fd7 None admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:18.501800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5603-6d31-4632-9b79-4bb56a7f5fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:18.502139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5603-6d31-4632-9b79-4bb56a7f5fd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:18.502877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f5603-6d31-4632-9b79-4bb56a7f5fd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:18.504239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f5603-6d31-4632-9b79-4bb56a7f5fd7 None admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:18.590192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 658/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Jul 11 14:37:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:37:28.329092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=30 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:28.585362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:36.710708 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d64e1-8dc2-4477-b89d-24e35db09c0f None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:36.711825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d64e1-8dc2-4477-b89d-24e35db09c0f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:36.711825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d64e1-8dc2-4477-b89d-24e35db09c0f None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:36.718463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c5811-bf05-4dd4-bc47-754475da7306 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:36.718925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c5811-bf05-4dd4-bc47-754475da7306 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:36.719015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c5811-bf05-4dd4-bc47-754475da7306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:36.722445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 649/1307] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:43:36 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:36.816219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0e5c5811-bf05-4dd4-bc47-754475da7306 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:36.817192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0e5c5811-bf05-4dd4-bc47-754475da7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:36.950624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 659/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:43:37.019098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39102ca-c03a-4d9b-9b3a-fe8712aa85a6 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:37.020178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39102ca-c03a-4d9b-9b3a-fe8712aa85a6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:37.021060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39102ca-c03a-4d9b-9b3a-fe8712aa85a6 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:37.025820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 650/1309] 10.222.0.20 () {54 vars in 964 bytes} [Mon Jul 11 14:43:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:37.031458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd6eb-7025-4b40-af36-73e2ff52854e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:37.034391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd6eb-7025-4b40-af36-73e2ff52854e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:37.034391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd6eb-7025-4b40-af36-73e2ff52854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:37.142576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e03fd6eb-7025-4b40-af36-73e2ff52854e None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:37.144030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e03fd6eb-7025-4b40-af36-73e2ff52854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:37.169947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:37.241779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 660/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Jul 11 14:43:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:37.248018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39102ca-c03a-4d9b-9b3a-fe8712aa85a6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:37.251126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a39102ca-c03a-4d9b-9b3a-fe8712aa85a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:37.377118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39102ca-c03a-4d9b-9b3a-fe8712aa85a6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:37.459560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe395b96-d105-44b2-b046-1a34a4872e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:37.460211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe395b96-d105-44b2-b046-1a34a4872e95 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:37.460499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe395b96-d105-44b2-b046-1a34a4872e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:37.460782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe395b96-d105-44b2-b046-1a34a4872e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:37.462510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-fe395b96-d105-44b2-b046-1a34a4872e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:37.521087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:37.587042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe395b96-d105-44b2-b046-1a34a4872e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:37.588514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe395b96-d105-44b2-b046-1a34a4872e95 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:37.609184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 651/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:43:39.991302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834ab4e-ff75-4d99-843f-5f0ee95485fb None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:39.992018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834ab4e-ff75-4d99-843f-5f0ee95485fb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:39.992018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834ab4e-ff75-4d99-843f-5f0ee95485fb None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:39.993824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 661/1312] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:43:39.999173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9464ad-8a34-43f7-8f07-eada971a4faa None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:39.999609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9464ad-8a34-43f7-8f07-eada971a4faa None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:39.999815 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9464ad-8a34-43f7-8f07-eada971a4faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.076727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ff9464ad-8a34-43f7-8f07-eada971a4faa None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:40.077945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ff9464ad-8a34-43f7-8f07-eada971a4faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:40.184624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 652/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:40.224165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834ab4e-ff75-4d99-843f-5f0ee95485fb None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:40.225715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0834ab4e-ff75-4d99-843f-5f0ee95485fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:40.339498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834ab4e-ff75-4d99-843f-5f0ee95485fb None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:40.413152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:40.416363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa73ce9-79ab-4018-a398-fe00a51d89f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:40.417012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73ce9-79ab-4018-a398-fe00a51d89f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.417298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73ce9-79ab-4018-a398-fe00a51d89f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.417575 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73ce9-79ab-4018-a398-fe00a51d89f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.419267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-efa73ce9-79ab-4018-a398-fe00a51d89f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:40.532126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa73ce9-79ab-4018-a398-fe00a51d89f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:40.533571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa73ce9-79ab-4018-a398-fe00a51d89f5 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:40.552818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 662/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:43.164497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205cd45-ae95-43ba-a64e-27d92b832941 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:43.165029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205cd45-ae95-43ba-a64e-27d92b832941 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:43.165129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205cd45-ae95-43ba-a64e-27d92b832941 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:43.166485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 653/1315] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:43.171624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aa083-7234-456c-86da-73fed80fced3 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:43.172057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aa083-7234-456c-86da-73fed80fced3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:43.172179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aa083-7234-456c-86da-73fed80fced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:43.238559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6b0aa083-7234-456c-86da-73fed80fced3 None None] MFA Rules not processed for user `0e178b8fd2ed47c08546f05bd3e7f914`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:43.239809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6b0aa083-7234-456c-86da-73fed80fced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:43.292884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:43.337946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 663/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:43:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:43.377314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205cd45-ae95-43ba-a64e-27d92b832941 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:43.378891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5205cd45-ae95-43ba-a64e-27d92b832941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:43.390007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:43.484117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205cd45-ae95-43ba-a64e-27d92b832941 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:43.559322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039612e-396e-4846-926a-9156df58fb36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:43.559965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039612e-396e-4846-926a-9156df58fb36 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:43.560246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039612e-396e-4846-926a-9156df58fb36 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:43.560561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039612e-396e-4846-926a-9156df58fb36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:43.562233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6039612e-396e-4846-926a-9156df58fb36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:43.634497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:43.681951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039612e-396e-4846-926a-9156df58fb36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:43.683729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039612e-396e-4846-926a-9156df58fb36 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:43.701816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 654/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:46.514519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3bab0-d26b-4f36-b215-558aac3e10a4 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:46.515079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3bab0-d26b-4f36-b215-558aac3e10a4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:46.515289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3bab0-d26b-4f36-b215-558aac3e10a4 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:46.516709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 664/1318] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:46.522209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31fbb-6344-4196-b1db-eba2f08f8724 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:46.522619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31fbb-6344-4196-b1db-eba2f08f8724 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:46.522767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31fbb-6344-4196-b1db-eba2f08f8724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:46.591167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3ea31fbb-6344-4196-b1db-eba2f08f8724 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:46.591357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3ea31fbb-6344-4196-b1db-eba2f08f8724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:46.689317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 655/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:46.727546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3bab0-d26b-4f36-b215-558aac3e10a4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:46.729094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-96a3bab0-d26b-4f36-b215-558aac3e10a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:46.834958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3bab0-d26b-4f36-b215-558aac3e10a4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:46.924428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4546c-8b95-4892-8893-a234d562bbbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:46.925077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4546c-8b95-4892-8893-a234d562bbbf service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:46.925367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4546c-8b95-4892-8893-a234d562bbbf service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:46.925648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4546c-8b95-4892-8893-a234d562bbbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:46.927364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4da4546c-8b95-4892-8893-a234d562bbbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:46.935672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:47.040417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4546c-8b95-4892-8893-a234d562bbbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:47.041975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4546c-8b95-4892-8893-a234d562bbbf service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:47.060568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 665/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:43:50.179157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb4b7-144e-4116-8902-dcb3b0414def None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:50.179697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb4b7-144e-4116-8902-dcb3b0414def None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:50.179697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb4b7-144e-4116-8902-dcb3b0414def None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:50.181094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 656/1321] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:50.186480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c79c8-5c60-4f4d-9d7b-993a6468e51b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:50.186921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c79c8-5c60-4f4d-9d7b-993a6468e51b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:50.187018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c79c8-5c60-4f4d-9d7b-993a6468e51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:50.251661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-469c79c8-5c60-4f4d-9d7b-993a6468e51b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:50.252863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-469c79c8-5c60-4f4d-9d7b-993a6468e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:50.313796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:50.354233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 666/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:50.390516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eb4b7-144e-4116-8902-dcb3b0414def None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:50.392116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1f7eb4b7-144e-4116-8902-dcb3b0414def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:50.412888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:50.508485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eb4b7-144e-4116-8902-dcb3b0414def None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:50.587321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c58f6-f1df-4fac-bada-73edecb43e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:50.587977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c58f6-f1df-4fac-bada-73edecb43e95 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:50.588533 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c58f6-f1df-4fac-bada-73edecb43e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:50.588533 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c58f6-f1df-4fac-bada-73edecb43e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:50.590183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d98c58f6-f1df-4fac-bada-73edecb43e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:50.665001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:50.703594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c58f6-f1df-4fac-bada-73edecb43e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:50.705032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c58f6-f1df-4fac-bada-73edecb43e95 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:50.724209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 657/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:52.845442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5b9e-6e80-4885-b964-1a791b0d3970 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:52.845948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5b9e-6e80-4885-b964-1a791b0d3970 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:52.845948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5b9e-6e80-4885-b964-1a791b0d3970 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:52.847396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 667/1324] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:52.853403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aafb8-fc9a-4e48-911a-9da87d7e9e82 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:52.853867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aafb8-fc9a-4e48-911a-9da87d7e9e82 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:52.854112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aafb8-fc9a-4e48-911a-9da87d7e9e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:52.922368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-305aafb8-fc9a-4e48-911a-9da87d7e9e82 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:52.923594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-305aafb8-fc9a-4e48-911a-9da87d7e9e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:53.022954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 658/1325] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:53.060436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c5b9e-6e80-4885-b964-1a791b0d3970 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:53.062069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b47c5b9e-6e80-4885-b964-1a791b0d3970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:53.168651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c5b9e-6e80-4885-b964-1a791b0d3970 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:53.249395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4672e-f24f-4694-b86a-e8a40068b433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:53.250064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4672e-f24f-4694-b86a-e8a40068b433 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:53.250396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4672e-f24f-4694-b86a-e8a40068b433 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:53.250676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4672e-f24f-4694-b86a-e8a40068b433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:53.252460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cab4672e-f24f-4694-b86a-e8a40068b433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:53.272231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:53.367024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4672e-f24f-4694-b86a-e8a40068b433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:53.368470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4672e-f24f-4694-b86a-e8a40068b433 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:53.386745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 668/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:55.527818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438345-36bb-4c54-a919-45caca9b9df7 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:55.528344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438345-36bb-4c54-a919-45caca9b9df7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:55.528437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438345-36bb-4c54-a919-45caca9b9df7 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:55.529752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 659/1327] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:55.534931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284c399-8087-4a27-8f84-02c8709f400e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:55.535365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284c399-8087-4a27-8f84-02c8709f400e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:55.535481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284c399-8087-4a27-8f84-02c8709f400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:55.601007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d284c399-8087-4a27-8f84-02c8709f400e None None] MFA Rules not processed for user `0e178b8fd2ed47c08546f05bd3e7f914`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:55.602259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d284c399-8087-4a27-8f84-02c8709f400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:55.672181 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:55.705508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 669/1328] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:43:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:55.758380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6264a-013a-4516-b81c-6098ad55e540 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:55.758665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6264a-013a-4516-b81c-6098ad55e540 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:55.758940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6264a-013a-4516-b81c-6098ad55e540 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:55.760342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 660/1329] 10.222.0.20 () {54 vars in 964 bytes} [Mon Jul 11 14:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:55.766255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03250f-4c19-4ffa-ada8-6d6d7153c020 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:55.766831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03250f-4c19-4ffa-ada8-6d6d7153c020 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:55.767155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03250f-4c19-4ffa-ada8-6d6d7153c020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:55.841031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ea03250f-4c19-4ffa-ada8-6d6d7153c020 None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:55.842257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ea03250f-4c19-4ffa-ada8-6d6d7153c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:55.919394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 670/1330] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Jul 11 14:43:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:55.928145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6264a-013a-4516-b81c-6098ad55e540 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:55.930281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9fd6264a-013a-4516-b81c-6098ad55e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:55.960572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:56.034229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6264a-013a-4516-b81c-6098ad55e540 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:56.123241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe33ee-5b40-4628-bc0c-c7b744646486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:56.123882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe33ee-5b40-4628-bc0c-c7b744646486 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:56.124162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe33ee-5b40-4628-bc0c-c7b744646486 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:56.124433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe33ee-5b40-4628-bc0c-c7b744646486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:56.126050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5ebe33ee-5b40-4628-bc0c-c7b744646486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:56.213448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:56.247683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe33ee-5b40-4628-bc0c-c7b744646486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:56.249145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe33ee-5b40-4628-bc0c-c7b744646486 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:56.267682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 661/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:59.124228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580944-9a00-4acf-8564-19b9d5461b7a None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:59.124780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580944-9a00-4acf-8564-19b9d5461b7a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:59.124780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580944-9a00-4acf-8564-19b9d5461b7a None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:59.126246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 671/1332] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:59.131700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960407-5d30-474f-8571-a43c1217c3dc None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:59.132105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960407-5d30-474f-8571-a43c1217c3dc None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:59.132258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960407-5d30-474f-8571-a43c1217c3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:59.195962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7e960407-5d30-474f-8571-a43c1217c3dc None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:59.197169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7e960407-5d30-474f-8571-a43c1217c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:59.292554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 662/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:59.327583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580944-9a00-4acf-8564-19b9d5461b7a None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:59.329148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c1580944-9a00-4acf-8564-19b9d5461b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:59.400228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:59.436973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580944-9a00-4acf-8564-19b9d5461b7a None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:59.512089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf74c0-a922-48b3-9df0-38dbb80bb6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:59.512744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf74c0-a922-48b3-9df0-38dbb80bb6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:59.513024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf74c0-a922-48b3-9df0-38dbb80bb6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:59.513300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf74c0-a922-48b3-9df0-38dbb80bb6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:59.514964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a4cf74c0-a922-48b3-9df0-38dbb80bb6a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:59.622947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf74c0-a922-48b3-9df0-38dbb80bb6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:59.624491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf74c0-a922-48b3-9df0-38dbb80bb6a8 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:59.635446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:59.643930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 672/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:01.734793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e9de-515e-4167-8e0b-9486ece85370 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:01.735356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e9de-515e-4167-8e0b-9486ece85370 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:01.735356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e9de-515e-4167-8e0b-9486ece85370 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:01.736701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 663/1335] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:01.742051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010263a-7eb8-48ff-856d-01f7fececa45 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:01.742522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010263a-7eb8-48ff-856d-01f7fececa45 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:01.742708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010263a-7eb8-48ff-856d-01f7fececa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:01.808967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9010263a-7eb8-48ff-856d-01f7fececa45 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:01.810200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9010263a-7eb8-48ff-856d-01f7fececa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:01.910030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 673/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:01.950327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e9de-515e-4167-8e0b-9486ece85370 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:01.951841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-21e5e9de-515e-4167-8e0b-9486ece85370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:01.991003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:02.053715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e9de-515e-4167-8e0b-9486ece85370 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:02.127661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a660e-40a9-45bd-8b75-23b3c81ffe82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:02.128296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a660e-40a9-45bd-8b75-23b3c81ffe82 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:02.128575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a660e-40a9-45bd-8b75-23b3c81ffe82 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:02.128848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a660e-40a9-45bd-8b75-23b3c81ffe82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:02.130754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d72a660e-40a9-45bd-8b75-23b3c81ffe82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:02.213839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:02.238830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a660e-40a9-45bd-8b75-23b3c81ffe82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:02.240352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a660e-40a9-45bd-8b75-23b3c81ffe82 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:02.261774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 664/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:05.090011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc2b6-2b22-488a-8729-875aaf5d68f0 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:05.090580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc2b6-2b22-488a-8729-875aaf5d68f0 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:05.090679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc2b6-2b22-488a-8729-875aaf5d68f0 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:05.092001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 674/1338] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:05.097671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9fba-7c3a-4997-b3e8-9993dddfc521 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:05.097671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9fba-7c3a-4997-b3e8-9993dddfc521 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:05.097671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9fba-7c3a-4997-b3e8-9993dddfc521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:05.163377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-52be9fba-7c3a-4997-b3e8-9993dddfc521 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:05.165208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-52be9fba-7c3a-4997-b3e8-9993dddfc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:05.264567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 665/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:05.301481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc2b6-2b22-488a-8729-875aaf5d68f0 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:05.303053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f1efc2b6-2b22-488a-8729-875aaf5d68f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:05.385870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:05.415631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc2b6-2b22-488a-8729-875aaf5d68f0 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:05.490035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5e148-9ebe-46ff-96e9-1e08c8a61da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:05.490727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e148-9ebe-46ff-96e9-1e08c8a61da1 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:05.491017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e148-9ebe-46ff-96e9-1e08c8a61da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:05.491300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e148-9ebe-46ff-96e9-1e08c8a61da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:05.492950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-93c5e148-9ebe-46ff-96e9-1e08c8a61da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:05.601442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5e148-9ebe-46ff-96e9-1e08c8a61da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:05.602906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5e148-9ebe-46ff-96e9-1e08c8a61da1 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:05.620883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 675/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:09.992318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747278-529f-4769-82a7-eb77dd247e32 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:09.992828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747278-529f-4769-82a7-eb77dd247e32 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:09.993106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747278-529f-4769-82a7-eb77dd247e32 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:09.995061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 666/1341] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:10.000991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7dd4-c836-4064-8a47-244893c8cc92 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:10.001546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7dd4-c836-4064-8a47-244893c8cc92 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:10.001546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7dd4-c836-4064-8a47-244893c8cc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:10.006646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:10.098199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-cf8d7dd4-c836-4064-8a47-244893c8cc92 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:10.098199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cf8d7dd4-c836-4064-8a47-244893c8cc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:10.209516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 676/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:10.253283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b747278-529f-4769-82a7-eb77dd247e32 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:10.258646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5b747278-529f-4769-82a7-eb77dd247e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:10.316416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:10.399596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b747278-529f-4769-82a7-eb77dd247e32 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:10.477124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a695d9e-fdf8-4a61-8fa9-16b02ae67ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:10.477774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695d9e-fdf8-4a61-8fa9-16b02ae67ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:10.478058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695d9e-fdf8-4a61-8fa9-16b02ae67ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:10.478439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695d9e-fdf8-4a61-8fa9-16b02ae67ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:10.479996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0a695d9e-fdf8-4a61-8fa9-16b02ae67ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:10.582589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:10.599077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a695d9e-fdf8-4a61-8fa9-16b02ae67ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:10.600542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a695d9e-fdf8-4a61-8fa9-16b02ae67ae4 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:10.624544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 667/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:13.573717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9946-53ee-4f90-b109-ab9b81ebe992 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:13.574306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9946-53ee-4f90-b109-ab9b81ebe992 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:13.574306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9946-53ee-4f90-b109-ab9b81ebe992 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:13.575682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 677/1344] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:13.581136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7fa17-c1e5-4715-8f71-76a84bdb0ff4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:13.581620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7fa17-c1e5-4715-8f71-76a84bdb0ff4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:13.581714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7fa17-c1e5-4715-8f71-76a84bdb0ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:13.647853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-faa7fa17-c1e5-4715-8f71-76a84bdb0ff4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:13.649110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-faa7fa17-c1e5-4715-8f71-76a84bdb0ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:13.752544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 668/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:13.791262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c9946-53ee-4f90-b109-ab9b81ebe992 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:13.792815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-aa2c9946-53ee-4f90-b109-ab9b81ebe992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:13.883606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:13.900972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c9946-53ee-4f90-b109-ab9b81ebe992 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:13.975435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15564f-226f-4b81-b44a-85c5eb31294a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:13.976613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15564f-226f-4b81-b44a-85c5eb31294a service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:13.976912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15564f-226f-4b81-b44a-85c5eb31294a service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:13.977187 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15564f-226f-4b81-b44a-85c5eb31294a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:13.983776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ab15564f-226f-4b81-b44a-85c5eb31294a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:14.093624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15564f-226f-4b81-b44a-85c5eb31294a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:14.095088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15564f-226f-4b81-b44a-85c5eb31294a service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:14.113789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 678/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:18.402221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4713268-31de-47e1-83c6-fae23192cf81 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:18.402767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4713268-31de-47e1-83c6-fae23192cf81 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:18.402767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4713268-31de-47e1-83c6-fae23192cf81 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:18.404154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 669/1347] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:18.409568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6d3f0-1f89-4b30-8b60-564ef1c4b706 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:18.410068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6d3f0-1f89-4b30-8b60-564ef1c4b706 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:18.410315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6d3f0-1f89-4b30-8b60-564ef1c4b706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:18.427712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:18.483990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0fe6d3f0-1f89-4b30-8b60-564ef1c4b706 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:18.485225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0fe6d3f0-1f89-4b30-8b60-564ef1c4b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:18.590066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 679/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:18.633606 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4713268-31de-47e1-83c6-fae23192cf81 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:18.635403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f4713268-31de-47e1-83c6-fae23192cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:18.705263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:18.763007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4713268-31de-47e1-83c6-fae23192cf81 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:18.848940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3a2aa-dcf6-409a-aabe-87fe8fa0457b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:18.849619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3a2aa-dcf6-409a-aabe-87fe8fa0457b service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:18.849906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3a2aa-dcf6-409a-aabe-87fe8fa0457b service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:18.850218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3a2aa-dcf6-409a-aabe-87fe8fa0457b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:18.852115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a0b3a2aa-dcf6-409a-aabe-87fe8fa0457b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:18.973107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:18.978555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3a2aa-dcf6-409a-aabe-87fe8fa0457b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:18.981260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3a2aa-dcf6-409a-aabe-87fe8fa0457b service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:19.002816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 670/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:23.902862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c251d1-b7d6-46fd-887e-bd2cf64aeaba None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:23.903398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c251d1-b7d6-46fd-887e-bd2cf64aeaba None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:23.903398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c251d1-b7d6-46fd-887e-bd2cf64aeaba None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:23.904805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 680/1350] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 14:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:23.909937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54847c84-7151-4590-9969-906aa465bad0 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:23.910481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54847c84-7151-4590-9969-906aa465bad0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:23.910765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54847c84-7151-4590-9969-906aa465bad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:24.018241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-54847c84-7151-4590-9969-906aa465bad0 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:24.019603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-54847c84-7151-4590-9969-906aa465bad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:24.211086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 671/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:28.481273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ddc49-17f7-40bc-af37-4c44f28f7763 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:28.482254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ddc49-17f7-40bc-af37-4c44f28f7763 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:28.482551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ddc49-17f7-40bc-af37-4c44f28f7763 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:28.485329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 681/1352] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 14:44:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:28.492904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ffd8-225a-4e0b-961a-581d902c4216 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:28.493427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ffd8-225a-4e0b-961a-581d902c4216 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:28.493513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ffd8-225a-4e0b-961a-581d902c4216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:28.551163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:28.576104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-2686ffd8-225a-4e0b-961a-581d902c4216 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:28.577329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2686ffd8-225a-4e0b-961a-581d902c4216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:28.588199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=59 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:28.704301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 672/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:30.208546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabca-930f-400f-a24f-6ae95dbae48e None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:30.209172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabca-930f-400f-a24f-6ae95dbae48e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:30.209172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabca-930f-400f-a24f-6ae95dbae48e None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:30.210659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 682/1354] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 14:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:30.216451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcbd4e-54bd-4460-9fb7-9ebbf5bd2a10 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:30.216920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcbd4e-54bd-4460-9fb7-9ebbf5bd2a10 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:30.217023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcbd4e-54bd-4460-9fb7-9ebbf5bd2a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:30.305586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3ffcbd4e-54bd-4460-9fb7-9ebbf5bd2a10 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:30.307744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3ffcbd4e-54bd-4460-9fb7-9ebbf5bd2a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:30.353010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:30.421931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 673/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:33.886373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2d8f3-7a73-418c-b1b3-d750bb51931e None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:33.887222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2d8f3-7a73-418c-b1b3-d750bb51931e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:33.887775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2d8f3-7a73-418c-b1b3-d750bb51931e None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:33.893227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 683/1356] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:33.894926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef00e2-10dd-4f37-8784-8ce044b26063 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:33.895757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef00e2-10dd-4f37-8784-8ce044b26063 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:33.896261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef00e2-10dd-4f37-8784-8ce044b26063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:33.977680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-94ef00e2-10dd-4f37-8784-8ce044b26063 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:33.980066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-94ef00e2-10dd-4f37-8784-8ce044b26063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:34.098171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 674/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:34.149400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075908cd-45dd-4668-bf8e-8f4e6df8cfa2 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:34.150132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075908cd-45dd-4668-bf8e-8f4e6df8cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:34.150674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075908cd-45dd-4668-bf8e-8f4e6df8cfa2 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:34.152853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 684/1358] 10.222.0.20 () {54 vars in 961 bytes} [Mon Jul 11 14:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:34.160031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f35313-2e4b-4055-9eff-52ee2668c9fb None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:34.160322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f35313-2e4b-4055-9eff-52ee2668c9fb None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:34.160602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f35313-2e4b-4055-9eff-52ee2668c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:34.182427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:34.260268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-24f35313-2e4b-4055-9eff-52ee2668c9fb None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:34.261481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-24f35313-2e4b-4055-9eff-52ee2668c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:34.400413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 675/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jul 11 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:34.408146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075908cd-45dd-4668-bf8e-8f4e6df8cfa2 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:34.409649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-075908cd-45dd-4668-bf8e-8f4e6df8cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:34.573255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075908cd-45dd-4668-bf8e-8f4e6df8cfa2 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:34.657038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:34.704051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0967e-f073-4fe5-8da9-38ecf95b6d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:34.704991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0967e-f073-4fe5-8da9-38ecf95b6d01 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:34.705285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0967e-f073-4fe5-8da9-38ecf95b6d01 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:34.705566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0967e-f073-4fe5-8da9-38ecf95b6d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:34.707281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-96f0967e-f073-4fe5-8da9-38ecf95b6d01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:34.809735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0967e-f073-4fe5-8da9-38ecf95b6d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:34.811378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0967e-f073-4fe5-8da9-38ecf95b6d01 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:34.838291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 685/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:37.065451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8393cb-3424-449a-b2ea-fdc9fba711ec None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:37.065856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8393cb-3424-449a-b2ea-fdc9fba711ec None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:37.066096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8393cb-3424-449a-b2ea-fdc9fba711ec None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:37.070486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 676/1361] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:37.073366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7ba0-e6f6-481b-9a0f-8d30dc2c3107 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:37.073833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7ba0-e6f6-481b-9a0f-8d30dc2c3107 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:37.073932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7ba0-e6f6-481b-9a0f-8d30dc2c3107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:37.150938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-304a7ba0-e6f6-481b-9a0f-8d30dc2c3107 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:37.152136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-304a7ba0-e6f6-481b-9a0f-8d30dc2c3107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:37.192068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:37.259348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 686/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:37.302719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8393cb-3424-449a-b2ea-fdc9fba711ec None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:37.305638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cf8393cb-3424-449a-b2ea-fdc9fba711ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:37.392129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:37.493396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8393cb-3424-449a-b2ea-fdc9fba711ec None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:37.651831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bf097-ab13-4953-83f6-256926dd937e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:37.652556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf097-ab13-4953-83f6-256926dd937e service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:37.652912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf097-ab13-4953-83f6-256926dd937e service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:37.653265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf097-ab13-4953-83f6-256926dd937e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:37.655021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3c5bf097-ab13-4953-83f6-256926dd937e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:37.680678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:37.753015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bf097-ab13-4953-83f6-256926dd937e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:37.754680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bf097-ab13-4953-83f6-256926dd937e service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:37.775377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 677/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:40.297514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aca71-a4d6-490b-a878-d40bb789f584 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:40.298031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aca71-a4d6-490b-a878-d40bb789f584 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:40.298198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aca71-a4d6-490b-a878-d40bb789f584 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:40.299647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 687/1364] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:40.305657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd3b09-3140-4649-9b99-87cb0688aa5c None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:40.306159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd3b09-3140-4649-9b99-87cb0688aa5c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:40.306464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd3b09-3140-4649-9b99-87cb0688aa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:40.395424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-2abd3b09-3140-4649-9b99-87cb0688aa5c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:40.397992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2abd3b09-3140-4649-9b99-87cb0688aa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:40.510627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:40.513263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 678/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:40.562854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647edbea-ea2c-4d53-a791-a11f8d3f84de None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:40.563151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647edbea-ea2c-4d53-a791-a11f8d3f84de None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:40.563438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647edbea-ea2c-4d53-a791-a11f8d3f84de None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:40.564833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 688/1366] 10.222.0.20 () {54 vars in 961 bytes} [Mon Jul 11 14:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:40.571643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee7c0-617a-4698-8894-c457e55c13c9 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:40.571938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee7c0-617a-4698-8894-c457e55c13c9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:40.572218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee7c0-617a-4698-8894-c457e55c13c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:40.671750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-babee7c0-617a-4698-8894-c457e55c13c9 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:40.673665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-babee7c0-617a-4698-8894-c457e55c13c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:40.881051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 679/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jul 11 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:40.888979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647edbea-ea2c-4d53-a791-a11f8d3f84de None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:40.890831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-647edbea-ea2c-4d53-a791-a11f8d3f84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:41.052030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647edbea-ea2c-4d53-a791-a11f8d3f84de None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:41.074427 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:41.206024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c671-d68f-4402-a8c2-30b91c049873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:41.207857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c671-d68f-4402-a8c2-30b91c049873 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:41.207857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c671-d68f-4402-a8c2-30b91c049873 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:41.207857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c671-d68f-4402-a8c2-30b91c049873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:41.208936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-aa94c671-d68f-4402-a8c2-30b91c049873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:41.357434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c671-d68f-4402-a8c2-30b91c049873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:41.357434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c671-d68f-4402-a8c2-30b91c049873 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:41.376817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 689/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:43.748694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87bc7d-71b0-4d9e-bfba-82ffe0413bae None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:43.749137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87bc7d-71b0-4d9e-bfba-82ffe0413bae None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:43.749337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87bc7d-71b0-4d9e-bfba-82ffe0413bae None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:43.757625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 680/1369] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:43.759086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134ac9-6e31-41b4-851c-891823d0713a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:43.760493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134ac9-6e31-41b4-851c-891823d0713a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:43.761137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134ac9-6e31-41b4-851c-891823d0713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:43.830545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:43.932743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-08134ac9-6e31-41b4-851c-891823d0713a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:43.934247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-08134ac9-6e31-41b4-851c-891823d0713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:44.074656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 690/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:44.122942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87bc7d-71b0-4d9e-bfba-82ffe0413bae None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:44.124787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0f87bc7d-71b0-4d9e-bfba-82ffe0413bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:44.206552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:44.315384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87bc7d-71b0-4d9e-bfba-82ffe0413bae None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:44.454370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85856732-e42b-48f9-a3e6-9210fa3c42bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:44.455069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85856732-e42b-48f9-a3e6-9210fa3c42bf service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:44.455363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85856732-e42b-48f9-a3e6-9210fa3c42bf service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:44.455642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85856732-e42b-48f9-a3e6-9210fa3c42bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:44.457642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-85856732-e42b-48f9-a3e6-9210fa3c42bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:44.469651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:44.575509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85856732-e42b-48f9-a3e6-9210fa3c42bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:44.577591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85856732-e42b-48f9-a3e6-9210fa3c42bf service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:44.602848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 681/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:45.934996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442f5a-0e01-4b3b-87a8-42fbe7156b8f None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:45.935581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442f5a-0e01-4b3b-87a8-42fbe7156b8f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:45.935581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442f5a-0e01-4b3b-87a8-42fbe7156b8f None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:45.936915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 691/1372] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:45.942253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9bca-8085-4380-8c3c-126c673899e0 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:45.942679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9bca-8085-4380-8c3c-126c673899e0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:45.942892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9bca-8085-4380-8c3c-126c673899e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:46.016126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-acda9bca-8085-4380-8c3c-126c673899e0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:46.017308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-acda9bca-8085-4380-8c3c-126c673899e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:46.102918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:46.124626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 682/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:46.462750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5ab9-e9ef-41d7-be63-9e4bf8b347d2 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:46.462750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5ab9-e9ef-41d7-be63-9e4bf8b347d2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:46.462750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5ab9-e9ef-41d7-be63-9e4bf8b347d2 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:46.464529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 692/1374] 10.222.0.20 () {54 vars in 963 bytes} [Mon Jul 11 14:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:46.468448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eab97-db76-4ddd-8aac-199bb826f20a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:46.468740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eab97-db76-4ddd-8aac-199bb826f20a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:46.469016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eab97-db76-4ddd-8aac-199bb826f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:46.561003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a20eab97-db76-4ddd-8aac-199bb826f20a None None] MFA Rules not processed for user `96a80e224da849e19538182793f13e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:46.562219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a20eab97-db76-4ddd-8aac-199bb826f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:46.645650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 683/1375] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Jul 11 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:46.653149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e5ab9-e9ef-41d7-be63-9e4bf8b347d2 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:46.654690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6b5e5ab9-e9ef-41d7-be63-9e4bf8b347d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:46.780970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e5ab9-e9ef-41d7-be63-9e4bf8b347d2 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:46.785031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:46.859593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a80e224da849e19538182793f13e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:46.860250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:46.860813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:46.861155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:46.862515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:46.972374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e31223-79b4-4b16-9742-72a4a77fcb31 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:46.972914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e31223-79b4-4b16-9742-72a4a77fcb31 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:46.973316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e31223-79b4-4b16-9742-72a4a77fcb31 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:46.975004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 684/1376] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:44:46.980745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672a4e-81a4-4c76-9484-81655f5c7e1d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:46.980975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672a4e-81a4-4c76-9484-81655f5c7e1d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:46.981265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672a4e-81a4-4c76-9484-81655f5c7e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:46.981567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:46.983119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:47.005689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 693/1377] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:47.053887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d3672a4e-81a4-4c76-9484-81655f5c7e1d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:47.055166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d3672a4e-81a4-4c76-9484-81655f5c7e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:47.089129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:47.160872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 685/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:47.210569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:47.211776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:47.249505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:47.315558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e51031-8355-4624-912e-80fbe032fbcd service cinder] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:47.434527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e4c39-c84a-457e-afbb-5d6e4337d9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:47.435177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e4c39-c84a-457e-afbb-5d6e4337d9dd service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:47.435460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e4c39-c84a-457e-afbb-5d6e4337d9dd service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:47.435739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e4c39-c84a-457e-afbb-5d6e4337d9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:47.437484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-eb1e4c39-c84a-457e-afbb-5d6e4337d9dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:47.485613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:47.530579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e4c39-c84a-457e-afbb-5d6e4337d9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:47.532115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e4c39-c84a-457e-afbb-5d6e4337d9dd service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:47.554280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 694/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:49.831424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126115-b51b-4f24-bf8a-ef8c6f77ba8a None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:49.831925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126115-b51b-4f24-bf8a-ef8c6f77ba8a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:49.831925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126115-b51b-4f24-bf8a-ef8c6f77ba8a None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:49.833326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 686/1380] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:49.839718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e6d7-0a2d-4f8c-8b3d-31382c7d9dd9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:49.840186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e6d7-0a2d-4f8c-8b3d-31382c7d9dd9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:49.840281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e6d7-0a2d-4f8c-8b3d-31382c7d9dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:49.930956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f697e6d7-0a2d-4f8c-8b3d-31382c7d9dd9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:49.932439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f697e6d7-0a2d-4f8c-8b3d-31382c7d9dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:50.040716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 695/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:50.086756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7126115-b51b-4f24-bf8a-ef8c6f77ba8a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:50.088372 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b7126115-b51b-4f24-bf8a-ef8c6f77ba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:50.255252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7126115-b51b-4f24-bf8a-ef8c6f77ba8a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:50.288214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:50.408081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4a773-e069-4bdb-8d3e-1e2699f4435b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:50.408654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a773-e069-4bdb-8d3e-1e2699f4435b service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:50.408936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a773-e069-4bdb-8d3e-1e2699f4435b service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:50.409211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a773-e069-4bdb-8d3e-1e2699f4435b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:50.410878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b6b4a773-e069-4bdb-8d3e-1e2699f4435b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:50.506129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4a773-e069-4bdb-8d3e-1e2699f4435b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:50.508221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4a773-e069-4bdb-8d3e-1e2699f4435b service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:50.527319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 687/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:52.803126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a15cb-90b0-4600-85b9-e08f92c8afd1 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:52.803722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a15cb-90b0-4600-85b9-e08f92c8afd1 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:52.803722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a15cb-90b0-4600-85b9-e08f92c8afd1 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:52.810444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200282-53fe-4f94-8c39-9a38424e3f68 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:52.810892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200282-53fe-4f94-8c39-9a38424e3f68 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:52.811084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200282-53fe-4f94-8c39-9a38424e3f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:52.814302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 696/1383] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:52.831789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:52.881373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-cc200282-53fe-4f94-8c39-9a38424e3f68 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:52.882819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cc200282-53fe-4f94-8c39-9a38424e3f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:52.995912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 688/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:53.039162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a15cb-90b0-4600-85b9-e08f92c8afd1 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:53.040821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4b2a15cb-90b0-4600-85b9-e08f92c8afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:53.066859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:53.229511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a15cb-90b0-4600-85b9-e08f92c8afd1 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:53.335549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:53.357062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86410-2d13-49e7-aacd-9756a5338009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:53.357734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86410-2d13-49e7-aacd-9756a5338009 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:53.358028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86410-2d13-49e7-aacd-9756a5338009 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:53.358372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86410-2d13-49e7-aacd-9756a5338009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:53.360075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fef86410-2d13-49e7-aacd-9756a5338009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:53.464613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86410-2d13-49e7-aacd-9756a5338009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:53.466270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86410-2d13-49e7-aacd-9756a5338009 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:53.486406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 697/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:55.543996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949fe7-2384-4b5a-b1ef-5f7bf5570d95 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:55.544729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949fe7-2384-4b5a-b1ef-5f7bf5570d95 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:55.544729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949fe7-2384-4b5a-b1ef-5f7bf5570d95 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:55.545834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 689/1386] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:55.551839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3be058-0917-4714-b04d-9891571d1288 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:55.552490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3be058-0917-4714-b04d-9891571d1288 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:55.555157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3be058-0917-4714-b04d-9891571d1288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:55.645353 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1f3be058-0917-4714-b04d-9891571d1288 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:55.647103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1f3be058-0917-4714-b04d-9891571d1288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:55.710591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:55.764181 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 698/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:55.818578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54949fe7-2384-4b5a-b1ef-5f7bf5570d95 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:55.820834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-54949fe7-2384-4b5a-b1ef-5f7bf5570d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:55.933524 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:55.990999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54949fe7-2384-4b5a-b1ef-5f7bf5570d95 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:56.111339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b93be-c7ff-4f96-8bc4-904b4ea8098b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:56.112133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b93be-c7ff-4f96-8bc4-904b4ea8098b service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:56.112491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b93be-c7ff-4f96-8bc4-904b4ea8098b service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:56.112835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b93be-c7ff-4f96-8bc4-904b4ea8098b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:56.114939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f71b93be-c7ff-4f96-8bc4-904b4ea8098b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:56.187605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:56.219031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b93be-c7ff-4f96-8bc4-904b4ea8098b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:56.221046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b93be-c7ff-4f96-8bc4-904b4ea8098b service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:56.239573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 690/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:58.405385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415790b-4265-4879-acd9-bce06a96b354 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.406083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415790b-4265-4879-acd9-bce06a96b354 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.406083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415790b-4265-4879-acd9-bce06a96b354 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.407379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 699/1389] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:58.413845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f503a-a3e2-4a83-8498-f197a7114b23 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.414330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f503a-a3e2-4a83-8498-f197a7114b23 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.414582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f503a-a3e2-4a83-8498-f197a7114b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.488004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d05f503a-a3e2-4a83-8498-f197a7114b23 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:58.489253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d05f503a-a3e2-4a83-8498-f197a7114b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:58.591882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 691/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:58.637978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415790b-4265-4879-acd9-bce06a96b354 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:58.639522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9415790b-4265-4879-acd9-bce06a96b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:58.813766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415790b-4265-4879-acd9-bce06a96b354 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:58.874340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:58.967362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846db6-9541-4241-9e2a-02c232556830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:58.968016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846db6-9541-4241-9e2a-02c232556830 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.968334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846db6-9541-4241-9e2a-02c232556830 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.968598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846db6-9541-4241-9e2a-02c232556830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.970340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-36846db6-9541-4241-9e2a-02c232556830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:59.070336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846db6-9541-4241-9e2a-02c232556830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:59.071937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846db6-9541-4241-9e2a-02c232556830 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:59.092298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 700/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:01.311496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d8b4-7307-40a5-a347-4866ff74ccfc None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:01.312081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d8b4-7307-40a5-a347-4866ff74ccfc None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:01.312081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d8b4-7307-40a5-a347-4866ff74ccfc None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:01.313375 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 692/1392] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:01.318790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0518f-5038-49e6-8303-071fdc3fb3ae None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:01.319273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0518f-5038-49e6-8303-071fdc3fb3ae None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:01.319383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0518f-5038-49e6-8303-071fdc3fb3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:01.376462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:01.384314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5aa0518f-5038-49e6-8303-071fdc3fb3ae None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:01.391136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5aa0518f-5038-49e6-8303-071fdc3fb3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:01.484793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 701/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:01.528948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7d8b4-7307-40a5-a347-4866ff74ccfc None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:01.530566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4ab7d8b4-7307-40a5-a347-4866ff74ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:01.572160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:01.679643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7d8b4-7307-40a5-a347-4866ff74ccfc None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:01.795591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:01.798203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f59a9-38d3-4bf6-8b39-5956757dbc42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:01.798860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f59a9-38d3-4bf6-8b39-5956757dbc42 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:01.799150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f59a9-38d3-4bf6-8b39-5956757dbc42 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:01.799429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f59a9-38d3-4bf6-8b39-5956757dbc42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:01.801083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-342f59a9-38d3-4bf6-8b39-5956757dbc42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:01.891455 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f59a9-38d3-4bf6-8b39-5956757dbc42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:01.893065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f59a9-38d3-4bf6-8b39-5956757dbc42 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:01.912748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 693/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:02.933621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0543-419c-41f6-9a8f-1d7e22a70844 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:02.934205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0543-419c-41f6-9a8f-1d7e22a70844 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:02.934205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0543-419c-41f6-9a8f-1d7e22a70844 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:02.935579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 702/1395] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:02.940885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47d71-9530-4f3c-a757-ab8043dfc9c8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:02.941356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47d71-9530-4f3c-a757-ab8043dfc9c8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:02.941472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47d71-9530-4f3c-a757-ab8043dfc9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:03.007771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-2ad47d71-9530-4f3c-a757-ab8043dfc9c8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:03.008965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2ad47d71-9530-4f3c-a757-ab8043dfc9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:03.082034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:03.111246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 694/1396] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:03.167817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66f6a-f7a0-4328-b014-0f14da40ba23 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:03.168135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66f6a-f7a0-4328-b014-0f14da40ba23 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:03.168428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66f6a-f7a0-4328-b014-0f14da40ba23 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:03.169848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 703/1397] 10.222.0.20 () {54 vars in 962 bytes} [Mon Jul 11 14:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:03.174959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f50a6-4f96-48b7-b9ff-831b2e05af2a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:03.175327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f50a6-4f96-48b7-b9ff-831b2e05af2a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:03.175697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f50a6-4f96-48b7-b9ff-831b2e05af2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:03.253356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a71f50a6-4f96-48b7-b9ff-831b2e05af2a None None] MFA Rules not processed for user `d42bb727957e40dca943c47785819223`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:03.254502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a71f50a6-4f96-48b7-b9ff-831b2e05af2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:03.329786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 695/1398] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Jul 11 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:03.338128 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb66f6a-f7a0-4328-b014-0f14da40ba23 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:03.339651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9fb66f6a-f7a0-4328-b014-0f14da40ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:03.446933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb66f6a-f7a0-4328-b014-0f14da40ba23 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:03.474265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:03.523023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f0ed6-f547-45cd-b0dc-d71e374a2f3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42bb727957e40dca943c47785819223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:03.523931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0ed6-f547-45cd-b0dc-d71e374a2f3d service glance] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:03.524216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0ed6-f547-45cd-b0dc-d71e374a2f3d service glance] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:03.524493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0ed6-f547-45cd-b0dc-d71e374a2f3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:03.526148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b25f0ed6-f547-45cd-b0dc-d71e374a2f3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:03.638512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f0ed6-f547-45cd-b0dc-d71e374a2f3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:03.639947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f0ed6-f547-45cd-b0dc-d71e374a2f3d service glance] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:03.658869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 704/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:04.352831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea9ef-2d5b-40a5-aa7e-a41f21fb0ace None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:04.357543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea9ef-2d5b-40a5-aa7e-a41f21fb0ace None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:04.357543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea9ef-2d5b-40a5-aa7e-a41f21fb0ace None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:04.357543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 696/1400] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:04.360155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a6f76-fe16-4106-a1f5-3bc969099f38 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:04.360593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a6f76-fe16-4106-a1f5-3bc969099f38 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:04.360900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a6f76-fe16-4106-a1f5-3bc969099f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:04.427271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6e5a6f76-fe16-4106-a1f5-3bc969099f38 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:04.428501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6e5a6f76-fe16-4106-a1f5-3bc969099f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:04.435293 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:04.490458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ead8-4a34-4488-b25c-5d8b25a810b7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:04.490789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ead8-4a34-4488-b25c-5d8b25a810b7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:04.491074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ead8-4a34-4488-b25c-5d8b25a810b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:04.536692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 705/1401] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:04.559147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7218ead8-4a34-4488-b25c-5d8b25a810b7 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:04.559147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7218ead8-4a34-4488-b25c-5d8b25a810b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:04.577083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:04.581704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a6f76-fe16-4106-a1f5-3bc969099f38 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:04.583553 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6e5a6f76-fe16-4106-a1f5-3bc969099f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:04.647832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 697/1402] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:04.691432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903feb-bcdb-4457-8436-8a934ab76240 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:04.691729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903feb-bcdb-4457-8436-8a934ab76240 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:04.692009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903feb-bcdb-4457-8436-8a934ab76240 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:04.693539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 698/1403] 10.222.0.20 () {54 vars in 942 bytes} [Mon Jul 11 14:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:45:04.700463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b422b9f-c298-437a-94d1-c9f53ef67d62 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:04.700753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b422b9f-c298-437a-94d1-c9f53ef67d62 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:04.701034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b422b9f-c298-437a-94d1-c9f53ef67d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:04.702478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a6f76-fe16-4106-a1f5-3bc969099f38 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:04.728478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:04.779510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0b422b9f-c298-437a-94d1-c9f53ef67d62 None None] MFA Rules not processed for user `0c3a489751424d008dbfefa89d19883a`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:04.780731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0b422b9f-c298-437a-94d1-c9f53ef67d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:04.822823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43af8b-9370-4185-9666-3684fc1c2449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:04.823396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43af8b-9370-4185-9666-3684fc1c2449 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:04.823679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43af8b-9370-4185-9666-3684fc1c2449 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:04.823958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43af8b-9370-4185-9666-3684fc1c2449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:04.825601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4d43af8b-9370-4185-9666-3684fc1c2449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:04.878313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:04.890868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 699/1404] 10.222.0.20 () {58 vars in 1039 bytes} [Mon Jul 11 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:04.900797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b422b9f-c298-437a-94d1-c9f53ef67d62 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:04.910798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b422b9f-c298-437a-94d1-c9f53ef67d62 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:04.919020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43af8b-9370-4185-9666-3684fc1c2449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:04.920628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43af8b-9370-4185-9666-3684fc1c2449 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:04.939217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 706/1405] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:05.017761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afa189-029a-4041-b66a-45d18a57cb8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:05.018443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa189-029a-4041-b66a-45d18a57cb8e service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:05.018723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa189-029a-4041-b66a-45d18a57cb8e service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:05.018989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa189-029a-4041-b66a-45d18a57cb8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:05.020670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-23afa189-029a-4041-b66a-45d18a57cb8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:05.110943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afa189-029a-4041-b66a-45d18a57cb8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:05.112624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afa189-029a-4041-b66a-45d18a57cb8e service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:05.122785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 700/1406] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 14:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:45:07.090804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0231-34e1-4a5f-a1d2-3a01e292606b None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:07.091341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0231-34e1-4a5f-a1d2-3a01e292606b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:07.091438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0231-34e1-4a5f-a1d2-3a01e292606b None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:07.092804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 707/1407] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:07.098300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce5a8-7533-4a77-ad99-d733ff0cbc70 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:07.098769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce5a8-7533-4a77-ad99-d733ff0cbc70 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:07.098862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce5a8-7533-4a77-ad99-d733ff0cbc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:07.120427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:07.179734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-5f0ce5a8-7533-4a77-ad99-d733ff0cbc70 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:07.181050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5f0ce5a8-7533-4a77-ad99-d733ff0cbc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:07.312337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 701/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:07.357607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0231-34e1-4a5f-a1d2-3a01e292606b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:07.359384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3e2b0231-34e1-4a5f-a1d2-3a01e292606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:07.395742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:07.542554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0231-34e1-4a5f-a1d2-3a01e292606b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:07.685700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd2a6c-806c-4227-a8c4-a39f850af38f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:07.686318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd2a6c-806c-4227-a8c4-a39f850af38f service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:07.686610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd2a6c-806c-4227-a8c4-a39f850af38f service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:07.686893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd2a6c-806c-4227-a8c4-a39f850af38f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:07.688687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b4fd2a6c-806c-4227-a8c4-a39f850af38f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:07.802802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:07.824877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd2a6c-806c-4227-a8c4-a39f850af38f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:07.826568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd2a6c-806c-4227-a8c4-a39f850af38f service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:07.851637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 708/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:17.310492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=57 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:18.213146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=49 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:29.796505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d3c8b-ae71-41c4-b781-f6b7626a7853 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:29.797129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d3c8b-ae71-41c4-b781-f6b7626a7853 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:29.797129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d3c8b-ae71-41c4-b781-f6b7626a7853 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:29.798462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 702/1410] 10.222.0.20 () {54 vars in 918 bytes} [Mon Jul 11 14:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:29.804253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613e63f-0e0b-4b50-8906-36d8a0d2677c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:29.804700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613e63f-0e0b-4b50-8906-36d8a0d2677c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:29.804809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613e63f-0e0b-4b50-8906-36d8a0d2677c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:29.880807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9613e63f-0e0b-4b50-8906-36d8a0d2677c None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:29.882040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9613e63f-0e0b-4b50-8906-36d8a0d2677c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:29.992704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 709/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Jul 11 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:30.007534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc693-aeb9-4726-87d0-803aea472265 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:30.007905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc693-aeb9-4726-87d0-803aea472265 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:30.008215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc693-aeb9-4726-87d0-803aea472265 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:30.009608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 703/1412] 10.222.0.20 () {54 vars in 918 bytes} [Mon Jul 11 14:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:30.014202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfea32-4bb4-424f-b93a-ff49683e9da9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:30.014496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfea32-4bb4-424f-b93a-ff49683e9da9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:30.014786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfea32-4bb4-424f-b93a-ff49683e9da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:30.086294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:30.089312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5bcfea32-4bb4-424f-b93a-ff49683e9da9 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:30.090572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5bcfea32-4bb4-424f-b93a-ff49683e9da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:30.208785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 710/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Jul 11 14:45:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:32.723900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432947d-52b4-45f4-b8f3-b0dd7e93a377 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:32.724426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432947d-52b4-45f4-b8f3-b0dd7e93a377 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:32.724570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432947d-52b4-45f4-b8f3-b0dd7e93a377 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:32.725876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:32.731176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d44ad-a170-4087-9dea-20da17a98dcc None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:32.731631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d44ad-a170-4087-9dea-20da17a98dcc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:32.731741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d44ad-a170-4087-9dea-20da17a98dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:32.800104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-054d44ad-a170-4087-9dea-20da17a98dcc None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:32.801312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-054d44ad-a170-4087-9dea-20da17a98dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:32.856891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:32.899270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:32.943163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432947d-52b4-45f4-b8f3-b0dd7e93a377 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:32.944780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a432947d-52b4-45f4-b8f3-b0dd7e93a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:33.092242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432947d-52b4-45f4-b8f3-b0dd7e93a377 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:33.168249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:33.210264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc65d2e-a12b-49b9-83d2-3b3cad96ac03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:33.210874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc65d2e-a12b-49b9-83d2-3b3cad96ac03 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:33.211156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc65d2e-a12b-49b9-83d2-3b3cad96ac03 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:33.211433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc65d2e-a12b-49b9-83d2-3b3cad96ac03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:33.213079 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2fc65d2e-a12b-49b9-83d2-3b3cad96ac03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:33.301572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc65d2e-a12b-49b9-83d2-3b3cad96ac03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:33.303246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc65d2e-a12b-49b9-83d2-3b3cad96ac03 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:33.321034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 705/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:34.218691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3db392-a8a7-4cb4-ab51-a0670a4ead3c None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:34.219294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3db392-a8a7-4cb4-ab51-a0670a4ead3c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:34.219294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3db392-a8a7-4cb4-ab51-a0670a4ead3c None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:34.220696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:45:34.226147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04696165-41d3-4b8c-8c8f-56e5a92cb9b8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:34.226563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04696165-41d3-4b8c-8c8f-56e5a92cb9b8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:34.226718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04696165-41d3-4b8c-8c8f-56e5a92cb9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:34.301359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-04696165-41d3-4b8c-8c8f-56e5a92cb9b8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:34.302638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-04696165-41d3-4b8c-8c8f-56e5a92cb9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:34.329883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:34.402091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:34.569234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3db392-a8a7-4cb4-ab51-a0670a4ead3c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:34.570759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ac3db392-a8a7-4cb4-ab51-a0670a4ead3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:34.717702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3db392-a8a7-4cb4-ab51-a0670a4ead3c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:34.758303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:34.830682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83140c21-646c-4b21-8f1c-c9c8505a30c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:34.831256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83140c21-646c-4b21-8f1c-c9c8505a30c4 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:34.831555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83140c21-646c-4b21-8f1c-c9c8505a30c4 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:34.831835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83140c21-646c-4b21-8f1c-c9c8505a30c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:34.833488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-83140c21-646c-4b21-8f1c-c9c8505a30c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:34.923033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83140c21-646c-4b21-8f1c-c9c8505a30c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:34.924660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83140c21-646c-4b21-8f1c-c9c8505a30c4 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:34.942369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 713/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:45:35.823906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e428-cc8c-4a78-bc09-74ec64bfa849 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.824483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e428-cc8c-4a78-bc09-74ec64bfa849 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.824483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e428-cc8c-4a78-bc09-74ec64bfa849 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.825839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:35.832209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ecef-0d28-4fc7-9d67-6a4aaf469f38 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.832716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ecef-0d28-4fc7-9d67-6a4aaf469f38 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.832816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ecef-0d28-4fc7-9d67-6a4aaf469f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.891570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:35.914037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5ae2ecef-0d28-4fc7-9d67-6a4aaf469f38 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.915231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5ae2ecef-0d28-4fc7-9d67-6a4aaf469f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.018061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.171706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e428-cc8c-4a78-bc09-74ec64bfa849 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.173149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7ab7e428-cc8c-4a78-bc09-74ec64bfa849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.323083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e428-cc8c-4a78-bc09-74ec64bfa849 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.335632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:36.448632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f26a-62e1-4961-a611-290425922f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.449195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f26a-62e1-4961-a611-290425922f90 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.449482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f26a-62e1-4961-a611-290425922f90 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.449757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f26a-62e1-4961-a611-290425922f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.451449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9053f26a-62e1-4961-a611-290425922f90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.540702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053f26a-62e1-4961-a611-290425922f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.542329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053f26a-62e1-4961-a611-290425922f90 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.559838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 708/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:37.416443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baee33-9bce-44de-9af2-c4e3aba1bc01 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.416979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baee33-9bce-44de-9af2-c4e3aba1bc01 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.416979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baee33-9bce-44de-9af2-c4e3aba1bc01 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.418425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:37.423565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0644fa-a0d0-4610-9d10-d676bfe7b4a7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.424046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0644fa-a0d0-4610-9d10-d676bfe7b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.424165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0644fa-a0d0-4610-9d10-d676bfe7b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.443116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:37.499150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7c0644fa-a0d0-4610-9d10-d676bfe7b4a7 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:37.500267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7c0644fa-a0d0-4610-9d10-d676bfe7b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:37.599344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:37.751708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baee33-9bce-44de-9af2-c4e3aba1bc01 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.753158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-60baee33-9bce-44de-9af2-c4e3aba1bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:37.866978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:37.905320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baee33-9bce-44de-9af2-c4e3aba1bc01 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:38.024941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980d9dd-d140-4640-8f36-3e34c46e65d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:38.025510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d9dd-d140-4640-8f36-3e34c46e65d1 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.025798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d9dd-d140-4640-8f36-3e34c46e65d1 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.026077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d9dd-d140-4640-8f36-3e34c46e65d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.027770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7980d9dd-d140-4640-8f36-3e34c46e65d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.105014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:38.118839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980d9dd-d140-4640-8f36-3e34c46e65d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:38.120477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980d9dd-d140-4640-8f36-3e34c46e65d1 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:38.139598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 716/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:39.018618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aa5cd-4ac5-43cf-b694-d83be14fdff3 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.019229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aa5cd-4ac5-43cf-b694-d83be14fdff3 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.019229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aa5cd-4ac5-43cf-b694-d83be14fdff3 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.020622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:39.026739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdcb54-96ee-4684-a093-0c3f079a01c0 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.027335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdcb54-96ee-4684-a093-0c3f079a01c0 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.027335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdcb54-96ee-4684-a093-0c3f079a01c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.110884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c4bdcb54-96ee-4684-a093-0c3f079a01c0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:39.112132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c4bdcb54-96ee-4684-a093-0c3f079a01c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:39.221980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:39.372905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aa5cd-4ac5-43cf-b694-d83be14fdff3 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.374551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c47aa5cd-4ac5-43cf-b694-d83be14fdff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:39.458479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:39.523399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aa5cd-4ac5-43cf-b694-d83be14fdff3 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.648243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340863f-74c9-4bc9-8592-db8b9f6fded1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.648803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340863f-74c9-4bc9-8592-db8b9f6fded1 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.649081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340863f-74c9-4bc9-8592-db8b9f6fded1 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.649352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340863f-74c9-4bc9-8592-db8b9f6fded1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.651088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4340863f-74c9-4bc9-8592-db8b9f6fded1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:39.815919 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:39.858470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340863f-74c9-4bc9-8592-db8b9f6fded1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.860053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340863f-74c9-4bc9-8592-db8b9f6fded1 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.878185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 711/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:40.715539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf468bc-3f1d-47d0-a9f5-a1b323145567 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.715994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf468bc-3f1d-47d0-a9f5-a1b323145567 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.716129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf468bc-3f1d-47d0-a9f5-a1b323145567 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.717549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:40.722391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9787a-baf4-4141-94bc-6052b40a057a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.722807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9787a-baf4-4141-94bc-6052b40a057a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.722951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9787a-baf4-4141-94bc-6052b40a057a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.798924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1fa9787a-baf4-4141-94bc-6052b40a057a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:40.800123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1fa9787a-baf4-4141-94bc-6052b40a057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:40.895796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:41.049426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf468bc-3f1d-47d0-a9f5-a1b323145567 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:41.050977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1cf468bc-3f1d-47d0-a9f5-a1b323145567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:41.099868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:41.199261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf468bc-3f1d-47d0-a9f5-a1b323145567 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:41.311551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509fc05-76b9-4e05-8d7d-5d03d3c903d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:41.312212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509fc05-76b9-4e05-8d7d-5d03d3c903d8 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.312500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509fc05-76b9-4e05-8d7d-5d03d3c903d8 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.312820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509fc05-76b9-4e05-8d7d-5d03d3c903d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.314521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1509fc05-76b9-4e05-8d7d-5d03d3c903d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:41.322035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:41.404917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509fc05-76b9-4e05-8d7d-5d03d3c903d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:41.406577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509fc05-76b9-4e05-8d7d-5d03d3c903d8 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:41.424534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 719/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:42.269953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a67f43-9d2f-4f6b-9dd2-1d258733e1a4 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.270536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a67f43-9d2f-4f6b-9dd2-1d258733e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.270536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a67f43-9d2f-4f6b-9dd2-1d258733e1a4 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.271918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:42.276797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a815ca-3323-41ec-a2d4-3a9ee26c2123 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.277211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a815ca-3323-41ec-a2d4-3a9ee26c2123 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.277350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a815ca-3323-41ec-a2d4-3a9ee26c2123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.350780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-60a815ca-3323-41ec-a2d4-3a9ee26c2123 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:42.351981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-60a815ca-3323-41ec-a2d4-3a9ee26c2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:42.419382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:42.449201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:42.600304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a67f43-9d2f-4f6b-9dd2-1d258733e1a4 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:42.601843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-61a67f43-9d2f-4f6b-9dd2-1d258733e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:42.619964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:42.748424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a67f43-9d2f-4f6b-9dd2-1d258733e1a4 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:42.838198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:42.864168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1de9b-a28d-4212-b50b-3f85172ad844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:42.864842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1de9b-a28d-4212-b50b-3f85172ad844 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.865122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1de9b-a28d-4212-b50b-3f85172ad844 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.865391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1de9b-a28d-4212-b50b-3f85172ad844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.867066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5dd1de9b-a28d-4212-b50b-3f85172ad844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:42.958023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1de9b-a28d-4212-b50b-3f85172ad844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:42.960181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1de9b-a28d-4212-b50b-3f85172ad844 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:42.979286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 714/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:43.844540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5b58-db71-4a14-9a52-9d9bdc87ada5 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:43.845096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5b58-db71-4a14-9a52-9d9bdc87ada5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:43.845096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5b58-db71-4a14-9a52-9d9bdc87ada5 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:43.846591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:43.851872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73118f-836d-4bbd-b139-b7e6684e8d4b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:43.852445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73118f-836d-4bbd-b139-b7e6684e8d4b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:43.852445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73118f-836d-4bbd-b139-b7e6684e8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:43.926357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-fc73118f-836d-4bbd-b139-b7e6684e8d4b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:43.927558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-fc73118f-836d-4bbd-b139-b7e6684e8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:43.973529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:44.029248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:44.183061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5b58-db71-4a14-9a52-9d9bdc87ada5 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:44.184559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-83df5b58-db71-4a14-9a52-9d9bdc87ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.333892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5b58-db71-4a14-9a52-9d9bdc87ada5 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:44.388192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:44.448100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48df46-6e3c-4653-aade-7a4675ca9000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:44.448751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48df46-6e3c-4653-aade-7a4675ca9000 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.449043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48df46-6e3c-4653-aade-7a4675ca9000 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.449382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48df46-6e3c-4653-aade-7a4675ca9000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.451073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ba48df46-6e3c-4653-aade-7a4675ca9000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.540829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48df46-6e3c-4653-aade-7a4675ca9000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:44.542443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48df46-6e3c-4653-aade-7a4675ca9000 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:44.561012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 722/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:45.444345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08e5f5-18ef-4f8c-aa1f-2d2a1d908169 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:45.444895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08e5f5-18ef-4f8c-aa1f-2d2a1d908169 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:45.444895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08e5f5-18ef-4f8c-aa1f-2d2a1d908169 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:45.446417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:45.451378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d499-e39d-4684-8909-32d894a4d95c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:45.451821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d499-e39d-4684-8909-32d894a4d95c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:45.451929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d499-e39d-4684-8909-32d894a4d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:45.525987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9490d499-e39d-4684-8909-32d894a4d95c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:45.527196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9490d499-e39d-4684-8909-32d894a4d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.529207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:45.623051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:45.773348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08e5f5-18ef-4f8c-aa1f-2d2a1d908169 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:45.774887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9c08e5f5-18ef-4f8c-aa1f-2d2a1d908169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.921692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08e5f5-18ef-4f8c-aa1f-2d2a1d908169 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:45.950525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:46.035764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19334f2b-48a1-4a3f-b872-c4715ba62eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:46.036350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334f2b-48a1-4a3f-b872-c4715ba62eda service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:46.036628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334f2b-48a1-4a3f-b872-c4715ba62eda service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:46.036900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334f2b-48a1-4a3f-b872-c4715ba62eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:46.038558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-19334f2b-48a1-4a3f-b872-c4715ba62eda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.125343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19334f2b-48a1-4a3f-b872-c4715ba62eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:46.126958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19334f2b-48a1-4a3f-b872-c4715ba62eda service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:46.145432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 717/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:48.056115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9dda-9bb9-4edd-8556-74274d6980e4 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.056648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9dda-9bb9-4edd-8556-74274d6980e4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.056648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9dda-9bb9-4edd-8556-74274d6980e4 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.057950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:48.063527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735fc33-e2d7-47dd-a7c6-701375c55ce9 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.063960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735fc33-e2d7-47dd-a7c6-701375c55ce9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.064086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735fc33-e2d7-47dd-a7c6-701375c55ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.103730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:48.127870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b735fc33-e2d7-47dd-a7c6-701375c55ce9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:48.132935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b735fc33-e2d7-47dd-a7c6-701375c55ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.226668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:48.266089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b9dda-9bb9-4edd-8556-74274d6980e4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:48.272289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4a4b9dda-9bb9-4edd-8556-74274d6980e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.371394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b9dda-9bb9-4edd-8556-74274d6980e4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:48.403885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:48.445502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7edc19-b41e-4431-886e-74ecf0fa8b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:48.446173 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7edc19-b41e-4431-886e-74ecf0fa8b22 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.446461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7edc19-b41e-4431-886e-74ecf0fa8b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.446758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7edc19-b41e-4431-886e-74ecf0fa8b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.448497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7c7edc19-b41e-4431-886e-74ecf0fa8b22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.559537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7edc19-b41e-4431-886e-74ecf0fa8b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:48.560969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7edc19-b41e-4431-886e-74ecf0fa8b22 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:48.578998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 725/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:50.766811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2dff-49b2-4be4-8d80-520354f8891a None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.767327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2dff-49b2-4be4-8d80-520354f8891a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.767432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2dff-49b2-4be4-8d80-520354f8891a None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.768714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:50.774715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d0e0-a6b1-4396-9793-d72a1ff6a665 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.775177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d0e0-a6b1-4396-9793-d72a1ff6a665 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.775280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d0e0-a6b1-4396-9793-d72a1ff6a665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.840202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6071d0e0-a6b1-4396-9793-d72a1ff6a665 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:50.841404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6071d0e0-a6b1-4396-9793-d72a1ff6a665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.855126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:50.943154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:50.980759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d2dff-49b2-4be4-8d80-520354f8891a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.982334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ad3d2dff-49b2-4be4-8d80-520354f8891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:51.089480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d2dff-49b2-4be4-8d80-520354f8891a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.102171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:51.165474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b568d-9f0b-4552-b642-9cdf3f22b0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.165474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b568d-9f0b-4552-b642-9cdf3f22b0ac service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.165474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b568d-9f0b-4552-b642-9cdf3f22b0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.166957 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b568d-9f0b-4552-b642-9cdf3f22b0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.168310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-fb4b568d-9f0b-4552-b642-9cdf3f22b0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:51.278845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b568d-9f0b-4552-b642-9cdf3f22b0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.280318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b568d-9f0b-4552-b642-9cdf3f22b0ac service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.299323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 720/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:53.782427 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099a03-0bd6-4322-8e56-f4476d9c0e7d None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.782953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099a03-0bd6-4322-8e56-f4476d9c0e7d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.783065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099a03-0bd6-4322-8e56-f4476d9c0e7d None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.784393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:53.790273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64a767-345c-4a77-ab72-d28cdd0614d6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.790973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64a767-345c-4a77-ab72-d28cdd0614d6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.790973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64a767-345c-4a77-ab72-d28cdd0614d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.841458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:53.861819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-cb64a767-345c-4a77-ab72-d28cdd0614d6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:53.863081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cb64a767-345c-4a77-ab72-d28cdd0614d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:53.965834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:54.006426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7099a03-0bd6-4322-8e56-f4476d9c0e7d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.008243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f7099a03-0bd6-4322-8e56-f4476d9c0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:54.119704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7099a03-0bd6-4322-8e56-f4476d9c0e7d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.165824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:54.207265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04596e4-3258-4651-90d3-33f3a85b3890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.208007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04596e4-3258-4651-90d3-33f3a85b3890 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.208421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04596e4-3258-4651-90d3-33f3a85b3890 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.209207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04596e4-3258-4651-90d3-33f3a85b3890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.210938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a04596e4-3258-4651-90d3-33f3a85b3890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:54.461674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04596e4-3258-4651-90d3-33f3a85b3890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.464324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04596e4-3258-4651-90d3-33f3a85b3890 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.488460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 728/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:56.700622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531204-0d84-4d25-aee5-a09fc959fe82 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.701120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531204-0d84-4d25-aee5-a09fc959fe82 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.701232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531204-0d84-4d25-aee5-a09fc959fe82 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.702771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:56.708087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41d189-fc15-46da-b7f2-f4b2f4fd04df None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.708522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41d189-fc15-46da-b7f2-f4b2f4fd04df None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.708669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41d189-fc15-46da-b7f2-f4b2f4fd04df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.779735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-af41d189-fc15-46da-b7f2-f4b2f4fd04df None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:56.780940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-af41d189-fc15-46da-b7f2-f4b2f4fd04df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:56.801596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:56.879697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:56.922878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a531204-0d84-4d25-aee5-a09fc959fe82 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:56.924383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4a531204-0d84-4d25-aee5-a09fc959fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:57.028517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a531204-0d84-4d25-aee5-a09fc959fe82 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.048836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:57.104664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d2102-d69d-4c7d-8ab5-a3044fed450f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.105316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d2102-d69d-4c7d-8ab5-a3044fed450f service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.105597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d2102-d69d-4c7d-8ab5-a3044fed450f service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.105870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d2102-d69d-4c7d-8ab5-a3044fed450f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.107557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f84d2102-d69d-4c7d-8ab5-a3044fed450f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:57.222726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d2102-d69d-4c7d-8ab5-a3044fed450f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.224191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d2102-d69d-4c7d-8ab5-a3044fed450f service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.243009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 723/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:59.360998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f503-1b69-46c0-bf65-70706f02961e None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.361563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f503-1b69-46c0-bf65-70706f02961e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.361563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f503-1b69-46c0-bf65-70706f02961e None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.363141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:59.369457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874da47-7526-43a7-b4d9-ecd02affdba6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.369916 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874da47-7526-43a7-b4d9-ecd02affdba6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.370033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874da47-7526-43a7-b4d9-ecd02affdba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.433477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:59.436545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3874da47-7526-43a7-b4d9-ecd02affdba6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:59.437770 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3874da47-7526-43a7-b4d9-ecd02affdba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:59.540528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:59.579624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47f503-1b69-46c0-bf65-70706f02961e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:59.581158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0b47f503-1b69-46c0-bf65-70706f02961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:59.689628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47f503-1b69-46c0-bf65-70706f02961e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:59.740928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:59.767336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98114de-e320-4319-8344-313c213738d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:59.768018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98114de-e320-4319-8344-313c213738d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.768306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98114de-e320-4319-8344-313c213738d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.768582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98114de-e320-4319-8344-313c213738d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.770310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a98114de-e320-4319-8344-313c213738d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:59.884938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98114de-e320-4319-8344-313c213738d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:59.886420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98114de-e320-4319-8344-313c213738d8 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:59.906091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 731/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:02.047098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400b9d-6af2-4b3a-8356-70ea79a4a100 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:02.047660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400b9d-6af2-4b3a-8356-70ea79a4a100 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:02.047660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400b9d-6af2-4b3a-8356-70ea79a4a100 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:02.048904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:02.054834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f06803-0937-40aa-8a49-e32ba08c0454 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:02.055251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f06803-0937-40aa-8a49-e32ba08c0454 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:02.055389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f06803-0937-40aa-8a49-e32ba08c0454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:02.118531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-42f06803-0937-40aa-8a49-e32ba08c0454 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:02.119737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-42f06803-0937-40aa-8a49-e32ba08c0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.148403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:02.216744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:02.256247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4400b9d-6af2-4b3a-8356-70ea79a4a100 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:02.257831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d4400b9d-6af2-4b3a-8356-70ea79a4a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.362943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4400b9d-6af2-4b3a-8356-70ea79a4a100 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:02.392210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:02.438629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960308cb-519d-438d-b117-17ba19bdb20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:02.439276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960308cb-519d-438d-b117-17ba19bdb20a service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:02.439555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960308cb-519d-438d-b117-17ba19bdb20a service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:02.439865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960308cb-519d-438d-b117-17ba19bdb20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:02.441499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-960308cb-519d-438d-b117-17ba19bdb20a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.552481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960308cb-519d-438d-b117-17ba19bdb20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:02.553910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960308cb-519d-438d-b117-17ba19bdb20a service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:02.574184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 726/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:04.652539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b838bc-76a9-42d5-8632-ee49fa52aeb1 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:04.653110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b838bc-76a9-42d5-8632-ee49fa52aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:04.653110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b838bc-76a9-42d5-8632-ee49fa52aeb1 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:04.654509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:04.660007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf5ece-292c-4e60-86f9-6ba98610b2f8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:04.660462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf5ece-292c-4e60-86f9-6ba98610b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:04.660566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf5ece-292c-4e60-86f9-6ba98610b2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:04.727420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4bcf5ece-292c-4e60-86f9-6ba98610b2f8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:04.728619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4bcf5ece-292c-4e60-86f9-6ba98610b2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:04.736682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:04.824956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:04.863137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b838bc-76a9-42d5-8632-ee49fa52aeb1 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:04.864699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f8b838bc-76a9-42d5-8632-ee49fa52aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:04.974795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b838bc-76a9-42d5-8632-ee49fa52aeb1 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:05.034610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:05.053259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8e3c9-414d-442d-9b1c-7817e1c1aa6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:05.053903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8e3c9-414d-442d-9b1c-7817e1c1aa6d service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:05.054216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8e3c9-414d-442d-9b1c-7817e1c1aa6d service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:05.054495 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8e3c9-414d-442d-9b1c-7817e1c1aa6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:05.056210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b2f8e3c9-414d-442d-9b1c-7817e1c1aa6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:05.169933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8e3c9-414d-442d-9b1c-7817e1c1aa6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:05.171401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8e3c9-414d-442d-9b1c-7817e1c1aa6d service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:05.189827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 734/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:07.285307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd75b-6f4c-42b3-bc8d-153122502ea8 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.285857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd75b-6f4c-42b3-bc8d-153122502ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.285857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd75b-6f4c-42b3-bc8d-153122502ea8 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.287934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:07.293319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dece7-4028-4b9b-b5ea-a1d88e3f25cc None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.293778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dece7-4028-4b9b-b5ea-a1d88e3f25cc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.293874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dece7-4028-4b9b-b5ea-a1d88e3f25cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.361151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d02dece7-4028-4b9b-b5ea-a1d88e3f25cc None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:07.362403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d02dece7-4028-4b9b-b5ea-a1d88e3f25cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.401357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:07.459768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:07.498306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd75b-6f4c-42b3-bc8d-153122502ea8 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:07.499834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-838fd75b-6f4c-42b3-bc8d-153122502ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.603594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd75b-6f4c-42b3-bc8d-153122502ea8 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:07.641318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:07.677307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524685bb-84f4-409a-a401-34b3a7a1b62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:07.677992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524685bb-84f4-409a-a401-34b3a7a1b62c service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.678339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524685bb-84f4-409a-a401-34b3a7a1b62c service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.678622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524685bb-84f4-409a-a401-34b3a7a1b62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.680269 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-524685bb-84f4-409a-a401-34b3a7a1b62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.791859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524685bb-84f4-409a-a401-34b3a7a1b62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:07.793312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524685bb-84f4-409a-a401-34b3a7a1b62c service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:07.812352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 729/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:09.891794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c49eff-8ab0-47c1-940c-95afb335954d None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.892381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c49eff-8ab0-47c1-940c-95afb335954d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.892381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c49eff-8ab0-47c1-940c-95afb335954d None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.893736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:09.899803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cc391-ba70-49a8-99b7-cd55e308d332 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.900224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cc391-ba70-49a8-99b7-cd55e308d332 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.900361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cc391-ba70-49a8-99b7-cd55e308d332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.966969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4c4cc391-ba70-49a8-99b7-cd55e308d332 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:09.968182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4c4cc391-ba70-49a8-99b7-cd55e308d332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.986724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:10.066911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:10.103581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c49eff-8ab0-47c1-940c-95afb335954d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.105102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c8c49eff-8ab0-47c1-940c-95afb335954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:10.209517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c49eff-8ab0-47c1-940c-95afb335954d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.276557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:10.283312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cc0f5-ddf8-4855-bdce-bd11a717b9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.283962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc0f5-ddf8-4855-bdce-bd11a717b9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.284245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc0f5-ddf8-4855-bdce-bd11a717b9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.284520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc0f5-ddf8-4855-bdce-bd11a717b9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.286354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-697cc0f5-ddf8-4855-bdce-bd11a717b9a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:10.396929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cc0f5-ddf8-4855-bdce-bd11a717b9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.398377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cc0f5-ddf8-4855-bdce-bd11a717b9a6 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.417607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 737/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:12.482759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29a2cc-001d-4f65-950b-3dd21b79e103 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.483326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29a2cc-001d-4f65-950b-3dd21b79e103 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.483442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29a2cc-001d-4f65-950b-3dd21b79e103 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.484830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:46:12.490557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a777-f4da-4914-8a3e-9daf49dba34c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.491001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a777-f4da-4914-8a3e-9daf49dba34c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.491099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a777-f4da-4914-8a3e-9daf49dba34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.555920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1357a777-f4da-4914-8a3e-9daf49dba34c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:12.557126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1357a777-f4da-4914-8a3e-9daf49dba34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:12.606413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:12.656110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:12.692025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29a2cc-001d-4f65-950b-3dd21b79e103 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.694161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4f29a2cc-001d-4f65-950b-3dd21b79e103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:12.799781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29a2cc-001d-4f65-950b-3dd21b79e103 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:12.847257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:12.872857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45638c-70e5-4146-b8e2-e1b540fd0b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:12.873500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45638c-70e5-4146-b8e2-e1b540fd0b76 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.873778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45638c-70e5-4146-b8e2-e1b540fd0b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.874050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45638c-70e5-4146-b8e2-e1b540fd0b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.875762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5c45638c-70e5-4146-b8e2-e1b540fd0b76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:12.985783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45638c-70e5-4146-b8e2-e1b540fd0b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:12.987306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45638c-70e5-4146-b8e2-e1b540fd0b76 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:13.008264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 732/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:22.668618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=22 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:23.005396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=66 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:33.094994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f3c0-885c-441a-ab86-6eb1614463f3 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.098812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f3c0-885c-441a-ab86-6eb1614463f3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.098812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f3c0-885c-441a-ab86-6eb1614463f3 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.098812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 739/1471] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:33.102378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963b96-4c2d-4297-bada-a7c79897f73a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.102828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963b96-4c2d-4297-bada-a7c79897f73a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.102936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963b96-4c2d-4297-bada-a7c79897f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.168835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d4963b96-4c2d-4297-bada-a7c79897f73a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:33.170042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d4963b96-4c2d-4297-bada-a7c79897f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:33.269303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 733/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:33.356346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c42932-f6e2-48c4-9c5b-973ce310fe3d None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.356637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c42932-f6e2-48c4-9c5b-973ce310fe3d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.356916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c42932-f6e2-48c4-9c5b-973ce310fe3d None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.358322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 740/1473] 10.222.0.20 () {54 vars in 962 bytes} [Mon Jul 11 14:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:33.363043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cabe0b-9280-400e-ab12-fda677459e56 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.363336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cabe0b-9280-400e-ab12-fda677459e56 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.363721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cabe0b-9280-400e-ab12-fda677459e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.438478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-13cabe0b-9280-400e-ab12-fda677459e56 None None] MFA Rules not processed for user `d42bb727957e40dca943c47785819223`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:33.439701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-13cabe0b-9280-400e-ab12-fda677459e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:33.460987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:33.518060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 734/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Jul 11 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:33.525622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c42932-f6e2-48c4-9c5b-973ce310fe3d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:33.527189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f6c42932-f6e2-48c4-9c5b-973ce310fe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:33.632245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c42932-f6e2-48c4-9c5b-973ce310fe3d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:33.705788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781363f-dd62-445b-b544-dd09ba310c02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42bb727957e40dca943c47785819223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:33.706565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781363f-dd62-445b-b544-dd09ba310c02 service glance] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.706899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781363f-dd62-445b-b544-dd09ba310c02 service glance] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.707172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781363f-dd62-445b-b544-dd09ba310c02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.709478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a781363f-dd62-445b-b544-dd09ba310c02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:33.764843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:33.824156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781363f-dd62-445b-b544-dd09ba310c02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:33.825601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781363f-dd62-445b-b544-dd09ba310c02 service glance] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:33.846359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 741/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:36.006556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51ceff-6a0a-495d-96cd-7d13028bd703 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:36.007069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51ceff-6a0a-495d-96cd-7d13028bd703 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:36.007069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51ceff-6a0a-495d-96cd-7d13028bd703 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:36.008475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 735/1476] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:36.013758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894896-a8a4-413f-9ea2-346db43ee348 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:36.014314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894896-a8a4-413f-9ea2-346db43ee348 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:36.014430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894896-a8a4-413f-9ea2-346db43ee348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:36.081306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-be894896-a8a4-413f-9ea2-346db43ee348 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:36.082553 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-be894896-a8a4-413f-9ea2-346db43ee348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:36.179988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 742/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:36.203936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51ceff-6a0a-495d-96cd-7d13028bd703 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:36.205480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4e51ceff-6a0a-495d-96cd-7d13028bd703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:36.330900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51ceff-6a0a-495d-96cd-7d13028bd703 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:36.382847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:36.428623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5aa78-5a1f-4df9-8491-f07bac348309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:36.429286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5aa78-5a1f-4df9-8491-f07bac348309 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:36.429576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5aa78-5a1f-4df9-8491-f07bac348309 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:36.429882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5aa78-5a1f-4df9-8491-f07bac348309 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:36.430698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5aa78-5a1f-4df9-8491-f07bac348309 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:36.432477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING py.warnings [None req-f4d5aa78-5a1f-4df9-8491-f07bac348309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:46:36.432477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: warnings.warn(msg) Jul 11 14:46:36.432477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: Jul 11 14:46:36.433636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5aa78-5a1f-4df9-8491-f07bac348309 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:36.454341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 736/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jul 11 14:46:36 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:38.545758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae14cf6-b32c-43f2-b042-14697c80a533 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:38.546355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae14cf6-b32c-43f2-b042-14697c80a533 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:38.546481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae14cf6-b32c-43f2-b042-14697c80a533 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:38.547850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 743/1479] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:38.553775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c90b-3f89-41a3-bba9-789022e46d70 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:38.554270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c90b-3f89-41a3-bba9-789022e46d70 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:38.554366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c90b-3f89-41a3-bba9-789022e46d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:38.620314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-cf65c90b-3f89-41a3-bba9-789022e46d70 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:38.621530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cf65c90b-3f89-41a3-bba9-789022e46d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:38.717728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 737/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:38.762587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae14cf6-b32c-43f2-b042-14697c80a533 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:38.764185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9ae14cf6-b32c-43f2-b042-14697c80a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:38.774201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:38.916376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae14cf6-b32c-43f2-b042-14697c80a533 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:38.998857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:39.032981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a5bd-6414-4765-ac16-0b19331ea6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:39.033872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a5bd-6414-4765-ac16-0b19331ea6bd service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:39.034198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a5bd-6414-4765-ac16-0b19331ea6bd service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:39.034479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a5bd-6414-4765-ac16-0b19331ea6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:39.036160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0cc1a5bd-6414-4765-ac16-0b19331ea6bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:39.128857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a5bd-6414-4765-ac16-0b19331ea6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:39.131042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a5bd-6414-4765-ac16-0b19331ea6bd service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:39.149623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 744/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:41.350868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6a005-bc81-4f74-bb29-3077e0967444 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.351434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6a005-bc81-4f74-bb29-3077e0967444 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.351434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6a005-bc81-4f74-bb29-3077e0967444 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.352891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 738/1482] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:41.358338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05e7fb-21ab-40fe-a5d0-609d9cb099c4 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.358751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05e7fb-21ab-40fe-a5d0-609d9cb099c4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.358907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05e7fb-21ab-40fe-a5d0-609d9cb099c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.428725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-cb05e7fb-21ab-40fe-a5d0-609d9cb099c4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:41.429945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cb05e7fb-21ab-40fe-a5d0-609d9cb099c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:41.476112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:41.526660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 745/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:41.562813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6a005-bc81-4f74-bb29-3077e0967444 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:41.564384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-abc6a005-bc81-4f74-bb29-3077e0967444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:41.588603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:41.667649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6a005-bc81-4f74-bb29-3077e0967444 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:41.740966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf2624-e743-4815-b715-9875116558ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:41.741678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf2624-e743-4815-b715-9875116558ad service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.741909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf2624-e743-4815-b715-9875116558ad service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.742214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf2624-e743-4815-b715-9875116558ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.743911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6fdf2624-e743-4815-b715-9875116558ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:41.818948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:41.854583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf2624-e743-4815-b715-9875116558ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:41.856027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf2624-e743-4815-b715-9875116558ad service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:41.874754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 739/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:43.948462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25556e76-40d8-4568-b819-e7408269d98c None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:43.949021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25556e76-40d8-4568-b819-e7408269d98c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:43.949021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25556e76-40d8-4568-b819-e7408269d98c None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:43.950449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 746/1485] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:43.955683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9000f1-024c-4cc2-8da0-e853ea1f93ab None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:43.956092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9000f1-024c-4cc2-8da0-e853ea1f93ab None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:43.956264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9000f1-024c-4cc2-8da0-e853ea1f93ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.024590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-dc9000f1-024c-4cc2-8da0-e853ea1f93ab None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:44.025720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-dc9000f1-024c-4cc2-8da0-e853ea1f93ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.123458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 740/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:44.162830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25556e76-40d8-4568-b819-e7408269d98c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:44.164378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-25556e76-40d8-4568-b819-e7408269d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.268824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25556e76-40d8-4568-b819-e7408269d98c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:44.343630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:44.345520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8583c67-c1f4-4079-b0d6-ac4b623b8c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:44.346222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8583c67-c1f4-4079-b0d6-ac4b623b8c13 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:44.346510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8583c67-c1f4-4079-b0d6-ac4b623b8c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:44.346788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8583c67-c1f4-4079-b0d6-ac4b623b8c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.348985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c8583c67-c1f4-4079-b0d6-ac4b623b8c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.460908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8583c67-c1f4-4079-b0d6-ac4b623b8c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:44.462401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8583c67-c1f4-4079-b0d6-ac4b623b8c13 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:44.481648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 747/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:46.689363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5788d-5ddb-43d2-aeab-a2e401d9a87b None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.689913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5788d-5ddb-43d2-aeab-a2e401d9a87b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.689913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5788d-5ddb-43d2-aeab-a2e401d9a87b None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.691295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 741/1488] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:46.696647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030070a-00ed-4fb3-b6f8-86aba79c828d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.697107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030070a-00ed-4fb3-b6f8-86aba79c828d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.697213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030070a-00ed-4fb3-b6f8-86aba79c828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.764322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-a030070a-00ed-4fb3-b6f8-86aba79c828d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:46.765553 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a030070a-00ed-4fb3-b6f8-86aba79c828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.819732 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:46.866477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 748/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:46.907393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5788d-5ddb-43d2-aeab-a2e401d9a87b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:46.909026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-29d5788d-5ddb-43d2-aeab-a2e401d9a87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.945578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:47.017957 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5788d-5ddb-43d2-aeab-a2e401d9a87b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:47.094364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b528e-bd85-4b9a-9d96-3afb267bcc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:47.095010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b528e-bd85-4b9a-9d96-3afb267bcc8f service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:47.095292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b528e-bd85-4b9a-9d96-3afb267bcc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:47.095568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b528e-bd85-4b9a-9d96-3afb267bcc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:47.097220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-148b528e-bd85-4b9a-9d96-3afb267bcc8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:47.177508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:47.207187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b528e-bd85-4b9a-9d96-3afb267bcc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:47.209177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b528e-bd85-4b9a-9d96-3afb267bcc8f service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:47.227895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 742/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:49.586264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8db047-afac-4d6a-aff3-c7992096e232 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:49.586810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8db047-afac-4d6a-aff3-c7992096e232 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:49.586930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8db047-afac-4d6a-aff3-c7992096e232 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.588318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 749/1491] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jul 11 14:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:49.593852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade039a-7418-466f-bad1-13155d1c976a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:49.594376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade039a-7418-466f-bad1-13155d1c976a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:49.594493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade039a-7418-466f-bad1-13155d1c976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.663181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-dade039a-7418-466f-bad1-13155d1c976a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:49.664411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-dade039a-7418-466f-bad1-13155d1c976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.765565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 743/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jul 11 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:49.805204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8db047-afac-4d6a-aff3-c7992096e232 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:49.806777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5b8db047-afac-4d6a-aff3-c7992096e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.915508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8db047-afac-4d6a-aff3-c7992096e232 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:49.993217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915179b3-f75c-41fe-9a20-75328b59afea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:49.993849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915179b3-f75c-41fe-9a20-75328b59afea service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:49.994162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915179b3-f75c-41fe-9a20-75328b59afea service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:49.994439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915179b3-f75c-41fe-9a20-75328b59afea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.996157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-915179b3-f75c-41fe-9a20-75328b59afea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.006593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:50.129800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915179b3-f75c-41fe-9a20-75328b59afea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:50.131902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915179b3-f75c-41fe-9a20-75328b59afea service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:50.150494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 750/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:59.763458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=82 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:00.148100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=50 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:39.943868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3212b8-0abf-4a2b-82af-d9e7138e6ba0 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:39.944385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3212b8-0abf-4a2b-82af-d9e7138e6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:39.944510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3212b8-0abf-4a2b-82af-d9e7138e6ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.025949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ee3212b8-0abf-4a2b-82af-d9e7138e6ba0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:40.027151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ee3212b8-0abf-4a2b-82af-d9e7138e6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:40.133411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 744/1494] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:40.141464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cad45-ccc3-4b93-81ad-2553358cc355 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.141959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cad45-ccc3-4b93-81ad-2553358cc355 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.142064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cad45-ccc3-4b93-81ad-2553358cc355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.161009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ee9cad45-ccc3-4b93-81ad-2553358cc355 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:40.162246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ee9cad45-ccc3-4b93-81ad-2553358cc355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:40.170885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 751/1495] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:40.175492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3212b8-0abf-4a2b-82af-d9e7138e6ba0 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:40.185405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3212b8-0abf-4a2b-82af-d9e7138e6ba0 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:40.190121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:40.190793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.191076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.191353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.192108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:40.192432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:40.193430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING py.warnings [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:48:40.193430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: warnings.warn(msg) Jul 11 14:48:40.193430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: Jul 11 14:48:40.194350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:40.206436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 745/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:40.215244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cad45-ccc3-4b93-81ad-2553358cc355 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:40.224694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cad45-ccc3-4b93-81ad-2553358cc355 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:40.229555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:40.230330 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.230617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.230898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.231626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:40.233382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING py.warnings [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:48:40.233382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: warnings.warn(msg) Jul 11 14:48:40.233382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: Jul 11 14:48:40.234618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:40.332037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 752/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:40 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:48:40.336105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:40.346721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cde18-bb4e-44d3-aef0-45c5a51bf2f5 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:40.399262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:40.406148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:40.406825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.407107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.407385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.408107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:40.409127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING py.warnings [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:48:40.409127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: warnings.warn(msg) Jul 11 14:48:40.409127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: Jul 11 14:48:40.410358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:40.501025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 746/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:40 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:40.505425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:40.516561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de8291-6a5c-43ff-8c47-94c29b65e4fb admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:40.521535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:40.522977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.522977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.522977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.523613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:40.524634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING py.warnings [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:48:40.524634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: warnings.warn(msg) Jul 11 14:48:40.524634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: Jul 11 14:48:40.525524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:40.538886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 753/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:40.542956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:40.553156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63412c-e1c8-4e3b-92c3-b7f8f49682e3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:40.558384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea9a5-718e-4151-86b4-8c38b2f919c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:40.559041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea9a5-718e-4151-86b4-8c38b2f919c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.559325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea9a5-718e-4151-86b4-8c38b2f919c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.559631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea9a5-718e-4151-86b4-8c38b2f919c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.560348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea9a5-718e-4151-86b4-8c38b2f919c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:40.561440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING py.warnings [None req-418ea9a5-718e-4151-86b4-8c38b2f919c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:48:40.561440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: warnings.warn(msg) Jul 11 14:48:40.561440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: Jul 11 14:48:40.562358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea9a5-718e-4151-86b4-8c38b2f919c8 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:40.576375 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 747/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:40.580551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:40.591176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1c446-6785-4a50-81b8-0926333f9c59 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:40.596008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112631-687d-4646-a6a5-12224bea742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:40.596908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112631-687d-4646-a6a5-12224bea742f admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.597300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112631-687d-4646-a6a5-12224bea742f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.597593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112631-687d-4646-a6a5-12224bea742f admin admin] PATH_INFO: `/v3/projects/71aaee205834457286550cef014f1d2e/users/df786538826641f6bb089e6ac15b0029/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.612913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112631-687d-4646-a6a5-12224bea742f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71aaee205834457286550cef014f1d2e, user_id=df786538826641f6bb089e6ac15b0029, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:40.613943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING py.warnings [None req-9c112631-687d-4646-a6a5-12224bea742f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:48:40.613943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: warnings.warn(msg) Jul 11 14:48:40.613943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: Jul 11 14:48:40.615937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112631-687d-4646-a6a5-12224bea742f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:40.672196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 754/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:40 2022] PUT /identity/v3/projects/71aaee205834457286550cef014f1d2e/users/df786538826641f6bb089e6ac15b0029/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:40.685070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722215-1668-4151-95dd-8508dff9e4e4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.685359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722215-1668-4151-95dd-8508dff9e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.685637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722215-1668-4151-95dd-8508dff9e4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.712087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-90722215-1668-4151-95dd-8508dff9e4e4 None None] MFA Rules not processed for user `df786538826641f6bb089e6ac15b0029`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:40.713489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-90722215-1668-4151-95dd-8508dff9e4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:40.780486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 748/1502] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:48:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:40.794073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4487d-52a2-4046-9c49-452954f1723e None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.794404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4487d-52a2-4046-9c49-452954f1723e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.794689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4487d-52a2-4046-9c49-452954f1723e None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.796061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 755/1503] 10.222.0.20 () {54 vars in 963 bytes} [Mon Jul 11 14:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:40.801083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212009-7d3c-4015-9af0-7d6db55d4fc0 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.801398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212009-7d3c-4015-9af0-7d6db55d4fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.801679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212009-7d3c-4015-9af0-7d6db55d4fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.860900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-38212009-7d3c-4015-9af0-7d6db55d4fc0 None None] MFA Rules not processed for user `96a80e224da849e19538182793f13e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:40.862010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-38212009-7d3c-4015-9af0-7d6db55d4fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:40.941848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 749/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Jul 11 14:48:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:40.950059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4487d-52a2-4046-9c49-452954f1723e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:40.961745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4487d-52a2-4046-9c49-452954f1723e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:40.965302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bd5c3-88ee-4281-bd59-494814387237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a80e224da849e19538182793f13e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:40.965935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bd5c3-88ee-4281-bd59-494814387237 service cinder] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.966244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bd5c3-88ee-4281-bd59-494814387237 service cinder] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.966519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bd5c3-88ee-4281-bd59-494814387237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.975079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bd5c3-88ee-4281-bd59-494814387237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:40.976512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bd5c3-88ee-4281-bd59-494814387237 service cinder] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:40.986078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 756/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:41.030015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bb420-7b9c-46a0-b9da-ce92444a89db None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:41.030490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bb420-7b9c-46a0-b9da-ce92444a89db None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:41.030689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bb420-7b9c-46a0-b9da-ce92444a89db None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:41.031982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 750/1506] 10.222.0.20 () {52 vars in 829 bytes} [Mon Jul 11 14:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:41.035491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bd5c3-88ee-4281-bd59-494814387237 service cinder] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:41.098290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bd5c3-88ee-4281-bd59-494814387237 service cinder] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:41.103729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:41.104684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:41.104873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:41.105154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] PATH_INFO: `/v3/users/df786538826641f6bb089e6ac15b0029` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:41.106403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df786538826641f6bb089e6ac15b0029)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:41.107422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING py.warnings [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:48:41.107422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: warnings.warn(msg) Jul 11 14:48:41.107422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: Jul 11 14:48:41.108640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:41.308639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df786538826641f6bb089e6ac15b0029'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.368753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df786538826641f6bb089e6ac15b0029'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.389101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df786538826641f6bb089e6ac15b0029'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.400041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:41.408836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df786538826641f6bb089e6ac15b0029'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.409623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df786538826641f6bb089e6ac15b0029'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.415700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 757/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:41 2022] DELETE /identity/v3/users/df786538826641f6bb089e6ac15b0029 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:41.420207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfaf0-8639-41bc-95ac-e43ccc49a1d4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:41.420501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfaf0-8639-41bc-95ac-e43ccc49a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:41.426690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfaf0-8639-41bc-95ac-e43ccc49a1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:41.438565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-63ddfaf0-8639-41bc-95ac-e43ccc49a1d4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:41.439781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-63ddfaf0-8639-41bc-95ac-e43ccc49a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:41.449534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:41.500012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 751/1508] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:41.510237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:41.511649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:41.589910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f2747-0dff-4f2f-ba42-0b44babff9e2 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:41.593618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110b23d-3408-4748-a63d-ab497d53a937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:41.594306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b23d-3408-4748-a63d-ab497d53a937 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:41.594594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b23d-3408-4748-a63d-ab497d53a937 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:41.594874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b23d-3408-4748-a63d-ab497d53a937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:41.603928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110b23d-3408-4748-a63d-ab497d53a937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:41.605357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110b23d-3408-4748-a63d-ab497d53a937 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:41.614856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 758/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:42.057001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddfaf0-8639-41bc-95ac-e43ccc49a1d4 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:42.058608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-63ddfaf0-8639-41bc-95ac-e43ccc49a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:42.070719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddfaf0-8639-41bc-95ac-e43ccc49a1d4 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:42.076856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:42.077854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:42.078178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:42.078462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] PATH_INFO: `/v3/projects/71aaee205834457286550cef014f1d2e` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:42.079781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71aaee205834457286550cef014f1d2e)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:42.080873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING py.warnings [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:48:42.080873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: warnings.warn(msg) Jul 11 14:48:42.080873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: Jul 11 14:48:42.082303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:42.205764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71aaee205834457286550cef014f1d2e', 'request_id': 'req-eecfd690-eb98-4eec-b80e-472c20850259'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.271816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71aaee205834457286550cef014f1d2e', 'request_id': 'req-eecfd690-eb98-4eec-b80e-472c20850259'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.278711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71aaee205834457286550cef014f1d2e', 'request_id': 'req-eecfd690-eb98-4eec-b80e-472c20850259'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.298841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] The token cache is being invalidate because project 71aaee205834457286550cef014f1d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:42.299137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.299819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-eecfd690-eb98-4eec-b80e-472c20850259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.301490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 752/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:42 2022] DELETE /identity/v3/projects/71aaee205834457286550cef014f1d2e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:48:51.610551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=38 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:52.295651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:51.823909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1423c-4bd7-4f36-be27-c6147ba15258 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:51.824508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1423c-4bd7-4f36-be27-c6147ba15258 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:51.824508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1423c-4bd7-4f36-be27-c6147ba15258 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:51.825905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:49:51.831418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b9d7-9193-4d8a-b65f-7c70a3268a21 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:51.831865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b9d7-9193-4d8a-b65f-7c70a3268a21 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:51.831977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b9d7-9193-4d8a-b65f-7c70a3268a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:51.849456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3c89b9d7-9193-4d8a-b65f-7c70a3268a21 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:51.850669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3c89b9d7-9193-4d8a-b65f-7c70a3268a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:51.908044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:52.061959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1423c-4bd7-4f36-be27-c6147ba15258 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:52.064259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d2a1423c-4bd7-4f36-be27-c6147ba15258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:52.165595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1423c-4bd7-4f36-be27-c6147ba15258 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:52.171139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f9b20-6d28-4e92-9580-ac777487a862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:52.172321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f9b20-6d28-4e92-9580-ac777487a862 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:52.172607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f9b20-6d28-4e92-9580-ac777487a862 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:52.172886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f9b20-6d28-4e92-9580-ac777487a862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:52.180953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f9b20-6d28-4e92-9580-ac777487a862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:52.182573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f9b20-6d28-4e92-9580-ac777487a862 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:52.192521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 760/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:53.010585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c45fa-cdec-4791-ae93-a2fbfb33b448 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:53.011115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c45fa-cdec-4791-ae93-a2fbfb33b448 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:53.011115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c45fa-cdec-4791-ae93-a2fbfb33b448 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:53.012254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:49:53.017543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4e724-5108-47f2-9e11-36c3b786605e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:53.017971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4e724-5108-47f2-9e11-36c3b786605e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:53.018127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4e724-5108-47f2-9e11-36c3b786605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:53.036902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4ff4e724-5108-47f2-9e11-36c3b786605e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:53.038126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4ff4e724-5108-47f2-9e11-36c3b786605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:53.046165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:53.198614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c45fa-cdec-4791-ae93-a2fbfb33b448 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:53.213447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c45fa-cdec-4791-ae93-a2fbfb33b448 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:53.218948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04ca7d-6e6b-45be-a725-8a7da15592bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:53.219580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ca7d-6e6b-45be-a725-8a7da15592bc service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:53.219870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ca7d-6e6b-45be-a725-8a7da15592bc service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:53.220152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ca7d-6e6b-45be-a725-8a7da15592bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:53.228286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04ca7d-6e6b-45be-a725-8a7da15592bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:53.229864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04ca7d-6e6b-45be-a725-8a7da15592bc service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:53.239229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 755/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:58.198353 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3ef2-82e9-4ccd-a90e-22b5a33dd9af None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:58.198975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3ef2-82e9-4ccd-a90e-22b5a33dd9af None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:58.198975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3ef2-82e9-4ccd-a90e-22b5a33dd9af None None] PATH_INFO: `/v3` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:58.200247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 762/1517] 10.222.0.83 () {54 vars in 925 bytes} [Mon Jul 11 14:49:58 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:58.207022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e238f-6870-492e-bb68-3ffd355eab1b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:58.207479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e238f-6870-492e-bb68-3ffd355eab1b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:58.207590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e238f-6870-492e-bb68-3ffd355eab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:58.257023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-464e238f-6870-492e-bb68-3ffd355eab1b None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:58.258308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-464e238f-6870-492e-bb68-3ffd355eab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:58.328868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 756/1518] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Jul 11 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:03.031441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=49 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:04.485243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19949e-d872-410b-beb3-aa5dc911a493 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:04.485941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19949e-d872-410b-beb3-aa5dc911a493 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:04.485941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19949e-d872-410b-beb3-aa5dc911a493 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:04.487291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 763/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:04.492084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10b49-4d30-4f85-8d61-e2b889bf6f89 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:04.496276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10b49-4d30-4f85-8d61-e2b889bf6f89 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:04.496276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10b49-4d30-4f85-8d61-e2b889bf6f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:04.511017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c9d10b49-4d30-4f85-8d61-e2b889bf6f89 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:04.512196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c9d10b49-4d30-4f85-8d61-e2b889bf6f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:04.520707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 757/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:04.672666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19949e-d872-410b-beb3-aa5dc911a493 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:04.687600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19949e-d872-410b-beb3-aa5dc911a493 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:04.693719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83938ec7-4e11-4cee-b356-f2883a2e5149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:04.694389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83938ec7-4e11-4cee-b356-f2883a2e5149 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:04.694702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83938ec7-4e11-4cee-b356-f2883a2e5149 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:04.694985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83938ec7-4e11-4cee-b356-f2883a2e5149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:04.703253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83938ec7-4e11-4cee-b356-f2883a2e5149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:04.705491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83938ec7-4e11-4cee-b356-f2883a2e5149 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:04.715136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 764/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:05.528217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366a6d-3890-43e6-9921-bb16319a411e None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.528782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366a6d-3890-43e6-9921-bb16319a411e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.528782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366a6d-3890-43e6-9921-bb16319a411e None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.530152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:05.535519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a9daa-dd92-4fb3-ad05-247c6e564630 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.535949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a9daa-dd92-4fb3-ad05-247c6e564630 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.536077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a9daa-dd92-4fb3-ad05-247c6e564630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.553755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-558a9daa-dd92-4fb3-ad05-247c6e564630 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:05.554982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-558a9daa-dd92-4fb3-ad05-247c6e564630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.563024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:05.714243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73366a6d-3890-43e6-9921-bb16319a411e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.729085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73366a6d-3890-43e6-9921-bb16319a411e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.734784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238104d-06b5-43cf-afc9-94a4621b1e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.735424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238104d-06b5-43cf-afc9-94a4621b1e07 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.735733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238104d-06b5-43cf-afc9-94a4621b1e07 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.736032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238104d-06b5-43cf-afc9-94a4621b1e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.746220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238104d-06b5-43cf-afc9-94a4621b1e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.747872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238104d-06b5-43cf-afc9-94a4621b1e07 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:05.757890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 759/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:06.893166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b1cf-3f08-4c52-91ae-e35e3a420b1f None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.893682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b1cf-3f08-4c52-91ae-e35e3a420b1f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.893682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b1cf-3f08-4c52-91ae-e35e3a420b1f None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.895082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 766/1525] 10.222.0.20 () {54 vars in 960 bytes} [Mon Jul 11 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:06.900005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27db00-10fa-44d8-b78f-9a04ac3a7a97 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.900402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27db00-10fa-44d8-b78f-9a04ac3a7a97 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.900556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27db00-10fa-44d8-b78f-9a04ac3a7a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.918823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9e27db00-10fa-44d8-b78f-9a04ac3a7a97 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:06.920015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9e27db00-10fa-44d8-b78f-9a04ac3a7a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:06.929241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 760/1526] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:06.936557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2b1cf-3f08-4c52-91ae-e35e3a420b1f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.949975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2b1cf-3f08-4c52-91ae-e35e3a420b1f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.955050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758231e-8c04-435c-bc56-c8c9705a18ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.955696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758231e-8c04-435c-bc56-c8c9705a18ae service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.955979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758231e-8c04-435c-bc56-c8c9705a18ae service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.956257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758231e-8c04-435c-bc56-c8c9705a18ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.964824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758231e-8c04-435c-bc56-c8c9705a18ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.966468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758231e-8c04-435c-bc56-c8c9705a18ae service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.976658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 767/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:16.914233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:16.972571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=15 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:16.979969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eeace-78b0-4c52-aa84-d4e6bc67e4d4 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:16.985271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eeace-78b0-4c52-aa84-d4e6bc67e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:16.985271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eeace-78b0-4c52-aa84-d4e6bc67e4d4 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:16.985271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:16.987278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4648-0ec7-427f-8d58-5ccf2e602188 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:16.987568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4648-0ec7-427f-8d58-5ccf2e602188 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:16.987849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4648-0ec7-427f-8d58-5ccf2e602188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:17.006244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5fcb4648-0ec7-427f-8d58-5ccf2e602188 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:17.007394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5fcb4648-0ec7-427f-8d58-5ccf2e602188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:17.015151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:17.168569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eeace-78b0-4c52-aa84-d4e6bc67e4d4 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:17.183852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eeace-78b0-4c52-aa84-d4e6bc67e4d4 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:17.189583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a64dd5-2365-4871-8c57-7cc5556feec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:17.190254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64dd5-2365-4871-8c57-7cc5556feec6 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:17.190539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64dd5-2365-4871-8c57-7cc5556feec6 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:17.190816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64dd5-2365-4871-8c57-7cc5556feec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:17.199657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64dd5-2365-4871-8c57-7cc5556feec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:17.201251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64dd5-2365-4871-8c57-7cc5556feec6 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:17.211907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 762/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:18.035504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92485-9f8d-47eb-bb71-275b42f454e4 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.036044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92485-9f8d-47eb-bb71-275b42f454e4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.036044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92485-9f8d-47eb-bb71-275b42f454e4 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.037374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:18.042321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6a2b-0eb8-401e-b299-91b13c64c9e7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.042748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6a2b-0eb8-401e-b299-91b13c64c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.042865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6a2b-0eb8-401e-b299-91b13c64c9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.061177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-197c6a2b-0eb8-401e-b299-91b13c64c9e7 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:18.062416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-197c6a2b-0eb8-401e-b299-91b13c64c9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:18.070939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:18.223853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92485-9f8d-47eb-bb71-275b42f454e4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:18.239159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92485-9f8d-47eb-bb71-275b42f454e4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:18.245149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d36a5-c33e-4de1-97be-8a7d93443bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:18.245918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d36a5-c33e-4de1-97be-8a7d93443bf4 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.246250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d36a5-c33e-4de1-97be-8a7d93443bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.246537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d36a5-c33e-4de1-97be-8a7d93443bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.256432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d36a5-c33e-4de1-97be-8a7d93443bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:18.258025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d36a5-c33e-4de1-97be-8a7d93443bf4 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.270695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 770/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:22.792994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b12953-0a22-4056-a5f5-85f8af42abac None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.793558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b12953-0a22-4056-a5f5-85f8af42abac None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.793558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b12953-0a22-4056-a5f5-85f8af42abac None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.794950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:22.800708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857947a-2cd2-4552-8c1f-1cc6e860ad9a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.801105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857947a-2cd2-4552-8c1f-1cc6e860ad9a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.801277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857947a-2cd2-4552-8c1f-1cc6e860ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.820036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0857947a-2cd2-4552-8c1f-1cc6e860ad9a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:22.821023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0857947a-2cd2-4552-8c1f-1cc6e860ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:22.829128 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:50:22.908051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b12953-0a22-4056-a5f5-85f8af42abac None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:22.909734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-92b12953-0a22-4056-a5f5-85f8af42abac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:22.971964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b12953-0a22-4056-a5f5-85f8af42abac None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:22.975682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e74fd2-d5fd-4ceb-9bed-018830ec9024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:22.976356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74fd2-d5fd-4ceb-9bed-018830ec9024 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.976637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74fd2-d5fd-4ceb-9bed-018830ec9024 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.976911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74fd2-d5fd-4ceb-9bed-018830ec9024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.986126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e74fd2-d5fd-4ceb-9bed-018830ec9024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:22.987552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e74fd2-d5fd-4ceb-9bed-018830ec9024 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.997434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 765/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:25.092113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306c60-bfdf-4801-aea5-71ebe8a00e9f None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:25.092725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306c60-bfdf-4801-aea5-71ebe8a00e9f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:25.092725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306c60-bfdf-4801-aea5-71ebe8a00e9f None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:25.094289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:25.100337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84b064-0903-4516-a0bd-10c99149030d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:25.100832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84b064-0903-4516-a0bd-10c99149030d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:25.100947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84b064-0903-4516-a0bd-10c99149030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:25.119362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0d84b064-0903-4516-a0bd-10c99149030d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:25.120559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0d84b064-0903-4516-a0bd-10c99149030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:25.129472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:25.169508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d306c60-bfdf-4801-aea5-71ebe8a00e9f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:25.181186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d306c60-bfdf-4801-aea5-71ebe8a00e9f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:25.184802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac352b28-9d48-4434-85e2-3f8f0e6fd262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:25.185441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac352b28-9d48-4434-85e2-3f8f0e6fd262 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:25.185734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac352b28-9d48-4434-85e2-3f8f0e6fd262 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:25.186020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac352b28-9d48-4434-85e2-3f8f0e6fd262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:25.197350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac352b28-9d48-4434-85e2-3f8f0e6fd262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:25.198862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac352b28-9d48-4434-85e2-3f8f0e6fd262 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:25.209025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 773/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:35.114202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=38 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:35.208678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=18 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:44.631584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d1c33-3329-4f88-9568-e4017e53f52d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:44.632223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d1c33-3329-4f88-9568-e4017e53f52d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:44.632223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d1c33-3329-4f88-9568-e4017e53f52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:44.655909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-030d1c33-3329-4f88-9568-e4017e53f52d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:44.657247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-030d1c33-3329-4f88-9568-e4017e53f52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:44.670617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 767/1540] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:44.679758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ac3b-c493-44f9-bb0e-f326d729d3c9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:44.681289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ac3b-c493-44f9-bb0e-f326d729d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:44.681827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ac3b-c493-44f9-bb0e-f326d729d3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:44.707733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-81e3ac3b-c493-44f9-bb0e-f326d729d3c9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:44.709302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-81e3ac3b-c493-44f9-bb0e-f326d729d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:44.720809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 774/1541] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:51:44.725731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d1c33-3329-4f88-9568-e4017e53f52d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:44.751926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d1c33-3329-4f88-9568-e4017e53f52d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:44.759506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6edcd-3701-4ba2-9eae-7724962de952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:44.760193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6edcd-3701-4ba2-9eae-7724962de952 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:44.760475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6edcd-3701-4ba2-9eae-7724962de952 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:44.760747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6edcd-3701-4ba2-9eae-7724962de952 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:44.761485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6edcd-3701-4ba2-9eae-7724962de952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:44.761793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6edcd-3701-4ba2-9eae-7724962de952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:44.763515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6edcd-3701-4ba2-9eae-7724962de952 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:44.781745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 768/1542] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:44.790400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3ac3b-c493-44f9-bb0e-f326d729d3c9 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:44.806087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3ac3b-c493-44f9-bb0e-f326d729d3c9 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:44.814406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121faac1-f7a0-409d-854b-22850be7dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:44.815509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121faac1-f7a0-409d-854b-22850be7dddc admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:44.816024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121faac1-f7a0-409d-854b-22850be7dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:44.816519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121faac1-f7a0-409d-854b-22850be7dddc admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:44.817637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121faac1-f7a0-409d-854b-22850be7dddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:44.819939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121faac1-f7a0-409d-854b-22850be7dddc admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:44.934984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 775/1543] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:44 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:44.935293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5017-00e9-4c8a-a23a-5cd0f72406db None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:44.935871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5017-00e9-4c8a-a23a-5cd0f72406db None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:44.936352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5017-00e9-4c8a-a23a-5cd0f72406db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:44.939449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121faac1-f7a0-409d-854b-22850be7dddc admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:44.962527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-751a5017-00e9-4c8a-a23a-5cd0f72406db None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:44.964797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-751a5017-00e9-4c8a-a23a-5cd0f72406db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.056311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121faac1-f7a0-409d-854b-22850be7dddc admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.079822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd6bc-7e48-4cde-9ebd-71f8e7dc5b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.080779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd6bc-7e48-4cde-9ebd-71f8e7dc5b43 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.081235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd6bc-7e48-4cde-9ebd-71f8e7dc5b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.081679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd6bc-7e48-4cde-9ebd-71f8e7dc5b43 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.082572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccd6bc-7e48-4cde-9ebd-71f8e7dc5b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.083911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING py.warnings [None req-12ccd6bc-7e48-4cde-9ebd-71f8e7dc5b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:51:45.083911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: warnings.warn(msg) Jul 11 14:51:45.083911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: Jul 11 14:51:45.085399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccd6bc-7e48-4cde-9ebd-71f8e7dc5b43 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.092245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 769/1544] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:51:45.097137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377c383-6ba1-45fa-8476-3d95049fc243 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.097137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377c383-6ba1-45fa-8476-3d95049fc243 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.097137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377c383-6ba1-45fa-8476-3d95049fc243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.124211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-f377c383-6ba1-45fa-8476-3d95049fc243 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.125557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f377c383-6ba1-45fa-8476-3d95049fc243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.138988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 770/1545] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.144474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509b15-cbc8-4108-bf25-a3d336be5ce4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.144474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509b15-cbc8-4108-bf25-a3d336be5ce4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.144474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509b15-cbc8-4108-bf25-a3d336be5ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.163688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-de509b15-cbc8-4108-bf25-a3d336be5ce4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.165597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-de509b15-cbc8-4108-bf25-a3d336be5ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.174743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 771/1546] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.176026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a7bcd-6423-4a53-b82e-830c86f72749 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.176316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a7bcd-6423-4a53-b82e-830c86f72749 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.176594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a7bcd-6423-4a53-b82e-830c86f72749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.198229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-e02a7bcd-6423-4a53-b82e-830c86f72749 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.199351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e02a7bcd-6423-4a53-b82e-830c86f72749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.202783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 776/1547] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:44 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:45.207421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75322c6-6622-46b2-8a18-5d2a46fee913 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.207421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75322c6-6622-46b2-8a18-5d2a46fee913 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.207421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75322c6-6622-46b2-8a18-5d2a46fee913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.210225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 772/1548] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.211749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe472-d0a5-44e3-842c-8f882ea35b40 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.212037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe472-d0a5-44e3-842c-8f882ea35b40 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.212317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe472-d0a5-44e3-842c-8f882ea35b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.233351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e75322c6-6622-46b2-8a18-5d2a46fee913 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.235043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-04cbe472-d0a5-44e3-842c-8f882ea35b40 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.235373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e75322c6-6622-46b2-8a18-5d2a46fee913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.236224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-04cbe472-d0a5-44e3-842c-8f882ea35b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.245377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 777/1549] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.247031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca9b9-650e-4f69-b9b4-23a7da8dc7c6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.247552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca9b9-650e-4f69-b9b4-23a7da8dc7c6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.248039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca9b9-650e-4f69-b9b4-23a7da8dc7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.249813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 773/1550] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.251954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11ef3-c730-4e38-b69c-4d691ede11f2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.252249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11ef3-c730-4e38-b69c-4d691ede11f2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.252529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11ef3-c730-4e38-b69c-4d691ede11f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.272187 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-a7eca9b9-650e-4f69-b9b4-23a7da8dc7c6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.274385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a7eca9b9-650e-4f69-b9b4-23a7da8dc7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.274616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-dec11ef3-c730-4e38-b69c-4d691ede11f2 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.275796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-dec11ef3-c730-4e38-b69c-4d691ede11f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.283423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 778/1551] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.284601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eca9b9-650e-4f69-b9b4-23a7da8dc7c6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.286653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 774/1552] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.287589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec11ef3-c730-4e38-b69c-4d691ede11f2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.296233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eca9b9-650e-4f69-b9b4-23a7da8dc7c6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.299030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec11ef3-c730-4e38-b69c-4d691ede11f2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.302831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.303609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.303938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.304223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.304999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:45.305116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0b6c-dda8-4fe2-a08c-4998a482b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.305314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.305803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0b6c-dda8-4fe2-a08c-4998a482b893 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.306259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0b6c-dda8-4fe2-a08c-4998a482b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.306367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING py.warnings [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:51:45.306367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: warnings.warn(msg) Jul 11 14:51:45.306367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: Jul 11 14:51:45.306723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0b6c-dda8-4fe2-a08c-4998a482b893 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.307270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.307458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0b6c-dda8-4fe2-a08c-4998a482b893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.309087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0b6c-dda8-4fe2-a08c-4998a482b893 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.319738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 775/1553] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:45.320182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 779/1554] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:45.321421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.321737 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46746e6c-94b1-46c4-9abe-ac9b4b34ddcd None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.322303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46746e6c-94b1-46c4-9abe-ac9b4b34ddcd None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.322817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46746e6c-94b1-46c4-9abe-ac9b4b34ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.332304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c526b-0dd0-48ca-893f-22f685551e7b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.337667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07091611-8296-44ec-b36a-41a41e5b4968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.338352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091611-8296-44ec-b36a-41a41e5b4968 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.338634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091611-8296-44ec-b36a-41a41e5b4968 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.338909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091611-8296-44ec-b36a-41a41e5b4968 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.339628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07091611-8296-44ec-b36a-41a41e5b4968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:45.339930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07091611-8296-44ec-b36a-41a41e5b4968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.341509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07091611-8296-44ec-b36a-41a41e5b4968 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.341771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-46746e6c-94b1-46c4-9abe-ac9b4b34ddcd None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.343004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-46746e6c-94b1-46c4-9abe-ac9b4b34ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.353553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 776/1555] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.361601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 780/1556] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:45.361753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886409-dfcc-4685-a094-132f63a62475 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.361753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886409-dfcc-4685-a094-132f63a62475 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.361753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886409-dfcc-4685-a094-132f63a62475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.361964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f88e9-2b60-48e0-9c4b-88479b06f53c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.361964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f88e9-2b60-48e0-9c4b-88479b06f53c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.361964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f88e9-2b60-48e0-9c4b-88479b06f53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.374639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-3f6f88e9-2b60-48e0-9c4b-88479b06f53c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.375683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-48886409-dfcc-4685-a094-132f63a62475 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.376219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3f6f88e9-2b60-48e0-9c4b-88479b06f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.377106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-48886409-dfcc-4685-a094-132f63a62475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.384912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 781/1557] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.385800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 777/1558] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.387093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d309f-8cc4-442a-8bd6-86d9545f065b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.387378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d309f-8cc4-442a-8bd6-86d9545f065b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.387656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d309f-8cc4-442a-8bd6-86d9545f065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.388166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3917f2-a293-48a7-8418-3d1db5398003 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.388652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3917f2-a293-48a7-8418-3d1db5398003 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.389150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3917f2-a293-48a7-8418-3d1db5398003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.407228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b60d309f-8cc4-442a-8bd6-86d9545f065b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.408424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b60d309f-8cc4-442a-8bd6-86d9545f065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.409151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ce3917f2-a293-48a7-8418-3d1db5398003 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.410376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ce3917f2-a293-48a7-8418-3d1db5398003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.416660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 778/1559] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.417658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d309f-8cc4-442a-8bd6-86d9545f065b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.418216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 782/1560] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.419000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3917f2-a293-48a7-8418-3d1db5398003 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.429601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d309f-8cc4-442a-8bd6-86d9545f065b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.429933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3917f2-a293-48a7-8418-3d1db5398003 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.434188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9a4c8-5ee6-4d2e-a7b4-8f727d86717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.434851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb022f-ebb8-4929-bd2e-ba587595806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.434969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9a4c8-5ee6-4d2e-a7b4-8f727d86717c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.435132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9a4c8-5ee6-4d2e-a7b4-8f727d86717c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.435525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9a4c8-5ee6-4d2e-a7b4-8f727d86717c admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.435628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb022f-ebb8-4929-bd2e-ba587595806a admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.435808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb022f-ebb8-4929-bd2e-ba587595806a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.436091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb022f-ebb8-4929-bd2e-ba587595806a admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.436269 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9a4c8-5ee6-4d2e-a7b4-8f727d86717c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.436776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb022f-ebb8-4929-bd2e-ba587595806a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.437825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9a4c8-5ee6-4d2e-a7b4-8f727d86717c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.438691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb022f-ebb8-4929-bd2e-ba587595806a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.449035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 779/1561] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:45.449844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9a4c8-5ee6-4d2e-a7b4-8f727d86717c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.460011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9a4c8-5ee6-4d2e-a7b4-8f727d86717c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.465161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.473120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.473120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.473120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.473120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.473120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING py.warnings [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:51:45.473120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: warnings.warn(msg) Jul 11 14:51:45.473120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: Jul 11 14:51:45.473651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.559803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 783/1562] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:45.559803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb022f-ebb8-4929-bd2e-ba587595806a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.576917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 780/1563] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/projects => generated 411 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:45.576917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.609440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:45.623935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb022f-ebb8-4929-bd2e-ba587595806a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.624609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:45.642351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b1c8e-292b-49ae-a5fe-eae02f5f4a77 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.647408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b333-aed3-4c66-994f-bc34d377313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.651753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b333-aed3-4c66-994f-bc34d377313c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.651753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b333-aed3-4c66-994f-bc34d377313c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.651753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b333-aed3-4c66-994f-bc34d377313c admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.651753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896b333-aed3-4c66-994f-bc34d377313c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:45.651753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896b333-aed3-4c66-994f-bc34d377313c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.652295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896b333-aed3-4c66-994f-bc34d377313c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.664231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 781/1564] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:45.665542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822077-7cb5-4f41-99a4-e1f266053a37 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.665836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822077-7cb5-4f41-99a4-e1f266053a37 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.666129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822077-7cb5-4f41-99a4-e1f266053a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.682534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.683253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.683472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.683756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.684537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:45.684851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.686512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.689756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c9822077-7cb5-4f41-99a4-e1f266053a37 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:45.691641 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c9822077-7cb5-4f41-99a4-e1f266053a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:45.699996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 784/1565] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:45.700768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.708819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 782/1566] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:45.709705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822077-7cb5-4f41-99a4-e1f266053a37 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.719288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b1fbb-02fe-4a34-aa2b-7139e59cfa30 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.720462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822077-7cb5-4f41-99a4-e1f266053a37 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.724148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.724775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.725059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.725173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.725328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.725790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.726052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:45.726287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.726389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.726561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.727613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:45.727925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.728022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.729508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.753882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 783/1567] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:45.754656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 785/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:45.754740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.754831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.759876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e70c75-9754-4861-810b-8885f4eab032 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.764529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.765419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.765809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.765990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] PATH_INFO: `/v3/projects/ca1da3e2bcee48f1886a96c31c45f667/users/66a79df6a87a40dda8e45864d0b4bdba/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.769343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add60d66-682b-41dd-9fad-e943b1a4c48f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.777306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abd544-4653-459d-98b8-60d1f538fffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.778418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd544-4653-459d-98b8-60d1f538fffb admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.778878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd544-4653-459d-98b8-60d1f538fffb admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.779353 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd544-4653-459d-98b8-60d1f538fffb admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.780572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abd544-4653-459d-98b8-60d1f538fffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.781789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1da3e2bcee48f1886a96c31c45f667, user_id=66a79df6a87a40dda8e45864d0b4bdba, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.782868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING py.warnings [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:51:45.782868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: warnings.warn(msg) Jul 11 14:51:45.782868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: Jul 11 14:51:45.783709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abd544-4653-459d-98b8-60d1f538fffb admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.784824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.892425 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 784/1569] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:45 2022] PUT /identity/v3/projects/ca1da3e2bcee48f1886a96c31c45f667/users/66a79df6a87a40dda8e45864d0b4bdba/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:45.893241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.923562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 786/1570] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:45.923562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abd544-4653-459d-98b8-60d1f538fffb admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:45.933773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abd544-4653-459d-98b8-60d1f538fffb admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.963704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0aa06-dda8-432c-b5f4-6fd6e721ba00 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:45.968446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa52c2-6fd4-4943-8db3-2d6ee57731f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.969129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa52c2-6fd4-4943-8db3-2d6ee57731f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.969418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa52c2-6fd4-4943-8db3-2d6ee57731f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.969698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa52c2-6fd4-4943-8db3-2d6ee57731f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:45.970507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa52c2-6fd4-4943-8db3-2d6ee57731f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:45.972436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa52c2-6fd4-4943-8db3-2d6ee57731f2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:45.998290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863677a-1bb6-4f3b-b439-6c88fe872b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:45.998963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863677a-1bb6-4f3b-b439-6c88fe872b82 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:45.999240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863677a-1bb6-4f3b-b439-6c88fe872b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:45.999545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863677a-1bb6-4f3b-b439-6c88fe872b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.000261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863677a-1bb6-4f3b-b439-6c88fe872b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.002478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863677a-1bb6-4f3b-b439-6c88fe872b82 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.071908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 785/1571] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/users => generated 306 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.072852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa52c2-6fd4-4943-8db3-2d6ee57731f2 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.082685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa52c2-6fd4-4943-8db3-2d6ee57731f2 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.087833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252034f-f1b4-4b01-ac7f-c0f49088ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.088469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252034f-f1b4-4b01-ac7f-c0f49088ad5b admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.088773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252034f-f1b4-4b01-ac7f-c0f49088ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.089025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252034f-f1b4-4b01-ac7f-c0f49088ad5b admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.089702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252034f-f1b4-4b01-ac7f-c0f49088ad5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.091635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252034f-f1b4-4b01-ac7f-c0f49088ad5b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.099610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 787/1572] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:45 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.100542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863677a-1bb6-4f3b-b439-6c88fe872b82 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.147652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:46.166081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863677a-1bb6-4f3b-b439-6c88fe872b82 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.171013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.171652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.171970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.172254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.172970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:46.173273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.174896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.186516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 788/1573] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:46.187352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.197260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577e19f-6686-4c22-8286-de41804182ff admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.202467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa5274-6f81-4b31-8324-9d7bdb4a3c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.203096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5274-6f81-4b31-8324-9d7bdb4a3c2f admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.203380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5274-6f81-4b31-8324-9d7bdb4a3c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.203656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5274-6f81-4b31-8324-9d7bdb4a3c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.204427 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa5274-6f81-4b31-8324-9d7bdb4a3c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.206321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa5274-6f81-4b31-8324-9d7bdb4a3c2f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.228031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 786/1574] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.228031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252034f-f1b4-4b01-ac7f-c0f49088ad5b admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.296505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252034f-f1b4-4b01-ac7f-c0f49088ad5b admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.301103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be067939-bbe1-4c52-b82f-801251648013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.301769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be067939-bbe1-4c52-b82f-801251648013 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.302081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be067939-bbe1-4c52-b82f-801251648013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.302383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be067939-bbe1-4c52-b82f-801251648013 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.303084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be067939-bbe1-4c52-b82f-801251648013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.305032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be067939-bbe1-4c52-b82f-801251648013 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.309453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:46.312964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 789/1575] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/projects => generated 357 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.313636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c86ce4-330c-4449-a2a7-d39845ff9704 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.313927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c86ce4-330c-4449-a2a7-d39845ff9704 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.314252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c86ce4-330c-4449-a2a7-d39845ff9704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.344516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-72c86ce4-330c-4449-a2a7-d39845ff9704 None None] MFA Rules not processed for user `66a79df6a87a40dda8e45864d0b4bdba`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:46.345740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-72c86ce4-330c-4449-a2a7-d39845ff9704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:46.412535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 790/1576] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:46.413464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c86ce4-330c-4449-a2a7-d39845ff9704 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.420954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 787/1577] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.420954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be067939-bbe1-4c52-b82f-801251648013 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.481716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c86ce4-330c-4449-a2a7-d39845ff9704 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.486281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1c41c-b200-495e-8f29-c6c3444393bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.486794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be067939-bbe1-4c52-b82f-801251648013 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.486952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1c41c-b200-495e-8f29-c6c3444393bd admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.487238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1c41c-b200-495e-8f29-c6c3444393bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.487525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1c41c-b200-495e-8f29-c6c3444393bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.488286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1c41c-b200-495e-8f29-c6c3444393bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.489872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1c41c-b200-495e-8f29-c6c3444393bd admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.492173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1176d-3de3-4a76-9feb-6e3c3172d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.492778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1176d-3de3-4a76-9feb-6e3c3172d9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.493064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1176d-3de3-4a76-9feb-6e3c3172d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.493349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1176d-3de3-4a76-9feb-6e3c3172d9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.494199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1176d-3de3-4a76-9feb-6e3c3172d9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.495712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1176d-3de3-4a76-9feb-6e3c3172d9d0 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.500612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 791/1578] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:46.501793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1c41c-b200-495e-8f29-c6c3444393bd admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.512882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 788/1579] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:46.512882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1176d-3de3-4a76-9feb-6e3c3172d9d0 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.514918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1c41c-b200-495e-8f29-c6c3444393bd admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.520953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1176d-3de3-4a76-9feb-6e3c3172d9d0 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.522349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b311793-8484-49dc-b72b-24302ed70d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.523228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b311793-8484-49dc-b72b-24302ed70d6b admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.524275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b311793-8484-49dc-b72b-24302ed70d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.524843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b311793-8484-49dc-b72b-24302ed70d6b admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.526135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b311793-8484-49dc-b72b-24302ed70d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.526245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63d57-9b9e-4c07-b5f2-791d85e637f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.526848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63d57-9b9e-4c07-b5f2-791d85e637f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.527139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63d57-9b9e-4c07-b5f2-791d85e637f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.527421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63d57-9b9e-4c07-b5f2-791d85e637f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.528107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63d57-9b9e-4c07-b5f2-791d85e637f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.529163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b311793-8484-49dc-b72b-24302ed70d6b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.530036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63d57-9b9e-4c07-b5f2-791d85e637f3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.630037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 792/1580] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.630898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b311793-8484-49dc-b72b-24302ed70d6b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.641554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b311793-8484-49dc-b72b-24302ed70d6b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.643356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 789/1581] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.644157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63d57-9b9e-4c07-b5f2-791d85e637f3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.665568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:46.705122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26423411-502d-44a1-944e-a402d5d2e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.705901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423411-502d-44a1-944e-a402d5d2e90e admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.706071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423411-502d-44a1-944e-a402d5d2e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.706403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423411-502d-44a1-944e-a402d5d2e90e admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.707096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26423411-502d-44a1-944e-a402d5d2e90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.709007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26423411-502d-44a1-944e-a402d5d2e90e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.710059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63d57-9b9e-4c07-b5f2-791d85e637f3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.715081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928ae9-ec47-4eaf-8b64-390046a324c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.715755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928ae9-ec47-4eaf-8b64-390046a324c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.716035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928ae9-ec47-4eaf-8b64-390046a324c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.716308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928ae9-ec47-4eaf-8b64-390046a324c8 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.717019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19928ae9-ec47-4eaf-8b64-390046a324c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.718966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19928ae9-ec47-4eaf-8b64-390046a324c8 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.838547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 793/1582] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.838547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26423411-502d-44a1-944e-a402d5d2e90e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.846657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26423411-502d-44a1-944e-a402d5d2e90e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.851548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb027-ecbd-4060-bd2d-9ec839f543f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.852239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb027-ecbd-4060-bd2d-9ec839f543f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.852528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb027-ecbd-4060-bd2d-9ec839f543f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.852815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb027-ecbd-4060-bd2d-9ec839f543f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.853507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb027-ecbd-4060-bd2d-9ec839f543f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.855378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 790/1583] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/users => generated 279 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.855489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb027-ecbd-4060-bd2d-9ec839f543f5 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.856669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928ae9-ec47-4eaf-8b64-390046a324c8 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:46.867138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928ae9-ec47-4eaf-8b64-390046a324c8 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:46.873310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53991edb-f72a-49e9-a9b3-b9fd82d7f8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:46.873904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53991edb-f72a-49e9-a9b3-b9fd82d7f8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.874222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53991edb-f72a-49e9-a9b3-b9fd82d7f8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.874496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53991edb-f72a-49e9-a9b3-b9fd82d7f8e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.875181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53991edb-f72a-49e9-a9b3-b9fd82d7f8e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:46.877448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53991edb-f72a-49e9-a9b3-b9fd82d7f8e3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:46.965918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 794/1584] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:46.965918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb027-ecbd-4060-bd2d-9ec839f543f5 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.004769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 791/1585] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:47.004769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53991edb-f72a-49e9-a9b3-b9fd82d7f8e3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.006341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53991edb-f72a-49e9-a9b3-b9fd82d7f8e3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.028437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb027-ecbd-4060-bd2d-9ec839f543f5 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.033407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824f37d-bd9e-45ec-af5a-f1975e12f3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.034089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f37d-bd9e-45ec-af5a-f1975e12f3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.034540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f37d-bd9e-45ec-af5a-f1975e12f3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.034830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f37d-bd9e-45ec-af5a-f1975e12f3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.035572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824f37d-bd9e-45ec-af5a-f1975e12f3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.037190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824f37d-bd9e-45ec-af5a-f1975e12f3c3 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.037589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:47.049862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 795/1586] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.050756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824f37d-bd9e-45ec-af5a-f1975e12f3c3 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.061442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824f37d-bd9e-45ec-af5a-f1975e12f3c3 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.066189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337de7e-9a37-42c4-800f-e3008b4e7b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.066861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337de7e-9a37-42c4-800f-e3008b4e7b17 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.067198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337de7e-9a37-42c4-800f-e3008b4e7b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.067480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337de7e-9a37-42c4-800f-e3008b4e7b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.068209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337de7e-9a37-42c4-800f-e3008b4e7b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.069396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba412b05-2f57-4877-9166-fc394d6bfe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.069801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337de7e-9a37-42c4-800f-e3008b4e7b17 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.070069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba412b05-2f57-4877-9166-fc394d6bfe07 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.070394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba412b05-2f57-4877-9166-fc394d6bfe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.070698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba412b05-2f57-4877-9166-fc394d6bfe07 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.073650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba412b05-2f57-4877-9166-fc394d6bfe07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.073650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba412b05-2f57-4877-9166-fc394d6bfe07 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.082213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 796/1587] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.083054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337de7e-9a37-42c4-800f-e3008b4e7b17 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.084162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 792/1588] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.086032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba412b05-2f57-4877-9166-fc394d6bfe07 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.096521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337de7e-9a37-42c4-800f-e3008b4e7b17 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.102371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188175f9-8c82-4aa3-9127-e9c2f52f92dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.102568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba412b05-2f57-4877-9166-fc394d6bfe07 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.102723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188175f9-8c82-4aa3-9127-e9c2f52f92dd admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.102817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188175f9-8c82-4aa3-9127-e9c2f52f92dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.103075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188175f9-8c82-4aa3-9127-e9c2f52f92dd admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.103776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188175f9-8c82-4aa3-9127-e9c2f52f92dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.105713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188175f9-8c82-4aa3-9127-e9c2f52f92dd admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.107111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c65dea-8db0-4fa1-a223-d088dd2aaf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.107774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c65dea-8db0-4fa1-a223-d088dd2aaf0f admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.108050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c65dea-8db0-4fa1-a223-d088dd2aaf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.108328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c65dea-8db0-4fa1-a223-d088dd2aaf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.109036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c65dea-8db0-4fa1-a223-d088dd2aaf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.110717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c65dea-8db0-4fa1-a223-d088dd2aaf0f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.122303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 793/1589] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.123175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c65dea-8db0-4fa1-a223-d088dd2aaf0f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.134510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c65dea-8db0-4fa1-a223-d088dd2aaf0f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.140129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacca3de-3b01-4646-86e9-70f0fe929758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.142311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacca3de-3b01-4646-86e9-70f0fe929758 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.142311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacca3de-3b01-4646-86e9-70f0fe929758 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.142311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacca3de-3b01-4646-86e9-70f0fe929758 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.142311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacca3de-3b01-4646-86e9-70f0fe929758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.143947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacca3de-3b01-4646-86e9-70f0fe929758 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.155467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 794/1590] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.156394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacca3de-3b01-4646-86e9-70f0fe929758 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.166378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacca3de-3b01-4646-86e9-70f0fe929758 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.170961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a6e6a-75e5-4f77-9944-811037435422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.171605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6e6a-75e5-4f77-9944-811037435422 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.171886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6e6a-75e5-4f77-9944-811037435422 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.172160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6e6a-75e5-4f77-9944-811037435422 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.172843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a6e6a-75e5-4f77-9944-811037435422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.174786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a6e6a-75e5-4f77-9944-811037435422 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.240852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 797/1591] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:47 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:47.241556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188175f9-8c82-4aa3-9127-e9c2f52f92dd admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.252420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188175f9-8c82-4aa3-9127-e9c2f52f92dd admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.257109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6eb0-6694-47f9-a7e0-8196e2ba29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.257720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6eb0-6694-47f9-a7e0-8196e2ba29be admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.258005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6eb0-6694-47f9-a7e0-8196e2ba29be admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.258313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6eb0-6694-47f9-a7e0-8196e2ba29be admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.259066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca6eb0-6694-47f9-a7e0-8196e2ba29be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.260656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca6eb0-6694-47f9-a7e0-8196e2ba29be admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.271911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 798/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.272744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6eb0-6694-47f9-a7e0-8196e2ba29be admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.276617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 795/1593] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:47 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:47.279885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a6e6a-75e5-4f77-9944-811037435422 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.286723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6eb0-6694-47f9-a7e0-8196e2ba29be admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.288178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a6e6a-75e5-4f77-9944-811037435422 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.292215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051cab3-2b29-4ab9-b368-344bfbea9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.293105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051cab3-2b29-4ab9-b368-344bfbea9b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.293391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051cab3-2b29-4ab9-b368-344bfbea9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.293670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051cab3-2b29-4ab9-b368-344bfbea9b5d admin admin] PATH_INFO: `/v3/projects/cfa64f50e0a945019c80be11c782d06f/users/aaddfdaef98f40568252faf626550cb6/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.293833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484231c-3f17-4388-a15d-9c52b4679ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.294643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484231c-3f17-4388-a15d-9c52b4679ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.294974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484231c-3f17-4388-a15d-9c52b4679ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.295230 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484231c-3f17-4388-a15d-9c52b4679ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.296092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484231c-3f17-4388-a15d-9c52b4679ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.297742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484231c-3f17-4388-a15d-9c52b4679ec9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.309621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 796/1594] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.310323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051cab3-2b29-4ab9-b368-344bfbea9b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa64f50e0a945019c80be11c782d06f, user_id=aaddfdaef98f40568252faf626550cb6, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.310460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484231c-3f17-4388-a15d-9c52b4679ec9 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.313167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051cab3-2b29-4ab9-b368-344bfbea9b5d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.320318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484231c-3f17-4388-a15d-9c52b4679ec9 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.325195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d20de4-7b5d-4837-90d9-cd9494466c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.326115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20de4-7b5d-4837-90d9-cd9494466c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.326764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20de4-7b5d-4837-90d9-cd9494466c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.326764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20de4-7b5d-4837-90d9-cd9494466c64 admin admin] PATH_INFO: `/v3/projects/664b410ad3454d46adab1bf66a0d75df/users/86fa57fa21584714b5c1094afdd291d4/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.349561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d20de4-7b5d-4837-90d9-cd9494466c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664b410ad3454d46adab1bf66a0d75df, user_id=86fa57fa21584714b5c1094afdd291d4, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.355484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d20de4-7b5d-4837-90d9-cd9494466c64 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.378644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 799/1595] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:47 2022] PUT /identity/v3/projects/cfa64f50e0a945019c80be11c782d06f/users/aaddfdaef98f40568252faf626550cb6/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:47.379466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051cab3-2b29-4ab9-b368-344bfbea9b5d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.405733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:47.441162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051cab3-2b29-4ab9-b368-344bfbea9b5d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.445810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de28b-596f-4691-bfd9-fba48b7724be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.446507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de28b-596f-4691-bfd9-fba48b7724be admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.446786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de28b-596f-4691-bfd9-fba48b7724be admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.447060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de28b-596f-4691-bfd9-fba48b7724be admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.447781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305de28b-596f-4691-bfd9-fba48b7724be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.449376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305de28b-596f-4691-bfd9-fba48b7724be admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.459448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 800/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.460234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de28b-596f-4691-bfd9-fba48b7724be admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.466358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 797/1597] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:47 2022] PUT /identity/v3/projects/664b410ad3454d46adab1bf66a0d75df/users/86fa57fa21584714b5c1094afdd291d4/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:47.467196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d20de4-7b5d-4837-90d9-cd9494466c64 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.474147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de28b-596f-4691-bfd9-fba48b7724be admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.535580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e52e21-e3f9-49e9-a9cb-0e927782ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.536167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52e21-e3f9-49e9-a9cb-0e927782ce43 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.536451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52e21-e3f9-49e9-a9cb-0e927782ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.536725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52e21-e3f9-49e9-a9cb-0e927782ce43 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.537446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e52e21-e3f9-49e9-a9cb-0e927782ce43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.539164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e52e21-e3f9-49e9-a9cb-0e927782ce43 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.542421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d20de4-7b5d-4837-90d9-cd9494466c64 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.547506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c177ffa-0897-401f-88c4-2c605e08d167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.548205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c177ffa-0897-401f-88c4-2c605e08d167 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.548492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c177ffa-0897-401f-88c4-2c605e08d167 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.548772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c177ffa-0897-401f-88c4-2c605e08d167 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.549531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c177ffa-0897-401f-88c4-2c605e08d167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.549873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 801/1598] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.550729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e52e21-e3f9-49e9-a9cb-0e927782ce43 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.551633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c177ffa-0897-401f-88c4-2c605e08d167 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.560990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e52e21-e3f9-49e9-a9cb-0e927782ce43 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.565537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 798/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.565537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c177ffa-0897-401f-88c4-2c605e08d167 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.565740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde176ea-b9a4-41bb-803c-a62cc119e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.566345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde176ea-b9a4-41bb-803c-a62cc119e8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.566631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde176ea-b9a4-41bb-803c-a62cc119e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.566906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde176ea-b9a4-41bb-803c-a62cc119e8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.567626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde176ea-b9a4-41bb-803c-a62cc119e8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.569227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde176ea-b9a4-41bb-803c-a62cc119e8d6 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.573097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c177ffa-0897-401f-88c4-2c605e08d167 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.577725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096605-8de3-4f01-9583-518a99adb162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.578416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096605-8de3-4f01-9583-518a99adb162 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.578704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096605-8de3-4f01-9583-518a99adb162 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.578989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096605-8de3-4f01-9583-518a99adb162 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.579465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 802/1600] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.579696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea096605-8de3-4f01-9583-518a99adb162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.580242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde176ea-b9a4-41bb-803c-a62cc119e8d6 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.581301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea096605-8de3-4f01-9583-518a99adb162 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.590629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde176ea-b9a4-41bb-803c-a62cc119e8d6 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.595494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 799/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.595494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec563204-2fee-4789-ae64-b2cf0f0de04b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.595494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec563204-2fee-4789-ae64-b2cf0f0de04b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.595494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec563204-2fee-4789-ae64-b2cf0f0de04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.595831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b2256-aba4-4e66-81cc-7eae9747d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.596418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2256-aba4-4e66-81cc-7eae9747d22a admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.596697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2256-aba4-4e66-81cc-7eae9747d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.596973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2256-aba4-4e66-81cc-7eae9747d22a admin admin] PATH_INFO: `/v3/projects/ff7fb57ab7154b83a448074b1e465dea/users/e53d0c7429474cfc84570a9d2e61605a/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.612272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ec563204-2fee-4789-ae64-b2cf0f0de04b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:47.613500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ec563204-2fee-4789-ae64-b2cf0f0de04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:47.613633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b2256-aba4-4e66-81cc-7eae9747d22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7fb57ab7154b83a448074b1e465dea, user_id=e53d0c7429474cfc84570a9d2e61605a, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.616363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b2256-aba4-4e66-81cc-7eae9747d22a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.621760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 800/1602] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:47.622607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec563204-2fee-4789-ae64-b2cf0f0de04b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.632645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec563204-2fee-4789-ae64-b2cf0f0de04b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.638232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc531-72e5-4618-ae77-b86dc624b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.639117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc531-72e5-4618-ae77-b86dc624b2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.639401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc531-72e5-4618-ae77-b86dc624b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.639686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc531-72e5-4618-ae77-b86dc624b2dd admin admin] PATH_INFO: `/v3/projects/cddfcba5ecec46fc8638d3fd2192fd69/users/d079c09918a649d88b2afa2a2ed44a3c/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.655767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc531-72e5-4618-ae77-b86dc624b2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cddfcba5ecec46fc8638d3fd2192fd69, user_id=d079c09918a649d88b2afa2a2ed44a3c, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.658520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc531-72e5-4618-ae77-b86dc624b2dd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.732298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 803/1603] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:47 2022] PUT /identity/v3/projects/ff7fb57ab7154b83a448074b1e465dea/users/e53d0c7429474cfc84570a9d2e61605a/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:47.733885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecbfad-792d-476b-bb08-0007f7912f4a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.734193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecbfad-792d-476b-bb08-0007f7912f4a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.734474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecbfad-792d-476b-bb08-0007f7912f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.762415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 801/1604] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:47 2022] PUT /identity/v3/projects/cddfcba5ecec46fc8638d3fd2192fd69/users/d079c09918a649d88b2afa2a2ed44a3c/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:47.765853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-07ecbfad-792d-476b-bb08-0007f7912f4a None None] MFA Rules not processed for user `86fa57fa21584714b5c1094afdd291d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:47.765992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc531-72e5-4618-ae77-b86dc624b2dd admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.766087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-07ecbfad-792d-476b-bb08-0007f7912f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:47.774813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:47.830154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc531-72e5-4618-ae77-b86dc624b2dd admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.834803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735e30e-7117-4ac1-8540-25b6851a37ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.835690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735e30e-7117-4ac1-8540-25b6851a37ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.835826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 804/1605] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:47.836609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecbfad-792d-476b-bb08-0007f7912f4a None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.838401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735e30e-7117-4ac1-8540-25b6851a37ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.838871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735e30e-7117-4ac1-8540-25b6851a37ea admin admin] PATH_INFO: `/v3/projects/5df78336079f44d3af9cb58e006203e8/users/6f9ac923bb1b4c29874b2d71e99b0d2d/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.847870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecbfad-792d-476b-bb08-0007f7912f4a None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.853339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649db984-4ef6-43fd-b52d-6bb6f37e94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.854022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db984-4ef6-43fd-b52d-6bb6f37e94c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.854350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db984-4ef6-43fd-b52d-6bb6f37e94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.854631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db984-4ef6-43fd-b52d-6bb6f37e94c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.855364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649db984-4ef6-43fd-b52d-6bb6f37e94c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.856974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649db984-4ef6-43fd-b52d-6bb6f37e94c2 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.857903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735e30e-7117-4ac1-8540-25b6851a37ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df78336079f44d3af9cb58e006203e8, user_id=6f9ac923bb1b4c29874b2d71e99b0d2d, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.859399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:47.860615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735e30e-7117-4ac1-8540-25b6851a37ea admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.868680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 805/1606] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:47.869524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649db984-4ef6-43fd-b52d-6bb6f37e94c2 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.879908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649db984-4ef6-43fd-b52d-6bb6f37e94c2 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.884800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.885950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.886474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.887155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] PATH_INFO: `/v3/projects/eece26c59ff041b8b249c3a586a72236/users/0788bf035cee4dbd93c77ae96e9c001d/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.902290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eece26c59ff041b8b249c3a586a72236, user_id=0788bf035cee4dbd93c77ae96e9c001d, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.904942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.938201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 802/1607] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:47 2022] PUT /identity/v3/projects/5df78336079f44d3af9cb58e006203e8/users/6f9ac923bb1b4c29874b2d71e99b0d2d/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:47.939032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735e30e-7117-4ac1-8540-25b6851a37ea admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.001794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735e30e-7117-4ac1-8540-25b6851a37ea admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.006805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cc2ee-0fa0-4151-a2e5-19f5dc2928b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.007692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cc2ee-0fa0-4151-a2e5-19f5dc2928b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.008167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cc2ee-0fa0-4151-a2e5-19f5dc2928b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.008448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cc2ee-0fa0-4151-a2e5-19f5dc2928b7 admin admin] PATH_INFO: `/v3/projects/b8e22eb1658147beb78518d892198553/users/858ae85f11a043888b3bd797db75fa67/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.013433 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 806/1608] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:47 2022] PUT /identity/v3/projects/eece26c59ff041b8b249c3a586a72236/users/0788bf035cee4dbd93c77ae96e9c001d/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:48.015058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.025879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:48.035186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cc2ee-0fa0-4151-a2e5-19f5dc2928b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e22eb1658147beb78518d892198553, user_id=858ae85f11a043888b3bd797db75fa67, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.035186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cc2ee-0fa0-4151-a2e5-19f5dc2928b7 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.085599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276f00-fd89-4291-ad9d-0d058e061a43 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.089885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ac99-9b27-4db8-a8de-5b6d81389962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.090584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ac99-9b27-4db8-a8de-5b6d81389962 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.090870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ac99-9b27-4db8-a8de-5b6d81389962 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.091152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ac99-9b27-4db8-a8de-5b6d81389962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.128125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 803/1609] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:47 2022] PUT /identity/v3/projects/b8e22eb1658147beb78518d892198553/users/858ae85f11a043888b3bd797db75fa67/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:48.129515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59dcf-bc3f-4dae-8c71-26544df054ff None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.129803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59dcf-bc3f-4dae-8c71-26544df054ff None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.130077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59dcf-bc3f-4dae-8c71-26544df054ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.149279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3fd59dcf-bc3f-4dae-8c71-26544df054ff None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:48.150646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3fd59dcf-bc3f-4dae-8c71-26544df054ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:48.160715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ac99-9b27-4db8-a8de-5b6d81389962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.162255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ac99-9b27-4db8-a8de-5b6d81389962 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.173469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 807/1610] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:48.175632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0587-c2a4-49d2-a07e-b4e94002ea72 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.175632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0587-c2a4-49d2-a07e-b4e94002ea72 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.175878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0587-c2a4-49d2-a07e-b4e94002ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.194094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d9cf0587-c2a4-49d2-a07e-b4e94002ea72 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:48.195350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d9cf0587-c2a4-49d2-a07e-b4e94002ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:48.217788 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 804/1611] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:48.218659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd59dcf-bc3f-4dae-8c71-26544df054ff None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.229827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd59dcf-bc3f-4dae-8c71-26544df054ff None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.235798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138047-4910-4288-939b-66008504b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.236477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138047-4910-4288-939b-66008504b551 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.236760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138047-4910-4288-939b-66008504b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.237039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138047-4910-4288-939b-66008504b551 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.237827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138047-4910-4288-939b-66008504b551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.239845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138047-4910-4288-939b-66008504b551 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.256334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:48.278385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 808/1612] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:48.278385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf0587-c2a4-49d2-a07e-b4e94002ea72 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.286367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf0587-c2a4-49d2-a07e-b4e94002ea72 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.291690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f4e2f-b4e2-4a4b-97f3-149afc1100e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.292608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4e2f-b4e2-4a4b-97f3-149afc1100e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.292888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4e2f-b4e2-4a4b-97f3-149afc1100e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.293162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4e2f-b4e2-4a4b-97f3-149afc1100e8 admin admin] PATH_INFO: `/v3/projects/ab35feede49d44d6b1e51c47399aab42/users/b200c810e6114fd7a26c18817d8717fa/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.309354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f4e2f-b4e2-4a4b-97f3-149afc1100e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab35feede49d44d6b1e51c47399aab42, user_id=b200c810e6114fd7a26c18817d8717fa, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.312294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f4e2f-b4e2-4a4b-97f3-149afc1100e8 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.386066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 805/1613] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/projects => generated 409 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:48.387394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c1bde-6c80-4fb2-b2fd-3d92dd7256fd None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.387685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c1bde-6c80-4fb2-b2fd-3d92dd7256fd None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.387967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c1bde-6c80-4fb2-b2fd-3d92dd7256fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.407857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:48.413262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 809/1614] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:48 2022] PUT /identity/v3/projects/ab35feede49d44d6b1e51c47399aab42/users/b200c810e6114fd7a26c18817d8717fa/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:48.414610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0853-42af-41a5-ac80-8aec0d8750a7 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.414908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0853-42af-41a5-ac80-8aec0d8750a7 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.415188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0853-42af-41a5-ac80-8aec0d8750a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.420933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-af9c1bde-6c80-4fb2-b2fd-3d92dd7256fd None None] MFA Rules not processed for user `6f9ac923bb1b4c29874b2d71e99b0d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:48.422339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-af9c1bde-6c80-4fb2-b2fd-3d92dd7256fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:48.447926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-20fc0853-42af-41a5-ac80-8aec0d8750a7 None None] MFA Rules not processed for user `0788bf035cee4dbd93c77ae96e9c001d`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:48.449136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-20fc0853-42af-41a5-ac80-8aec0d8750a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:48.510832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 806/1615] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:48.511800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c1bde-6c80-4fb2-b2fd-3d92dd7256fd None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.550289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 810/1616] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:48.551166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc0853-42af-41a5-ac80-8aec0d8750a7 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.606569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c1bde-6c80-4fb2-b2fd-3d92dd7256fd None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.611482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe2ea-3a7a-4cc1-8442-e5764866eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.612062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe2ea-3a7a-4cc1-8442-e5764866eebf admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.612355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe2ea-3a7a-4cc1-8442-e5764866eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.612635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe2ea-3a7a-4cc1-8442-e5764866eebf admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.613483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbe2ea-3a7a-4cc1-8442-e5764866eebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.615010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbe2ea-3a7a-4cc1-8442-e5764866eebf admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.615722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc0853-42af-41a5-ac80-8aec0d8750a7 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.622393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a79be-32d5-4243-b168-1b0dbbb7bbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.623172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a79be-32d5-4243-b168-1b0dbbb7bbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.623743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a79be-32d5-4243-b168-1b0dbbb7bbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.624109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a79be-32d5-4243-b168-1b0dbbb7bbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.629470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 807/1617] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:48.629470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe2ea-3a7a-4cc1-8442-e5764866eebf admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.636018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a79be-32d5-4243-b168-1b0dbbb7bbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.637783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a79be-32d5-4243-b168-1b0dbbb7bbe1 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.639112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe2ea-3a7a-4cc1-8442-e5764866eebf admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.642917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0dd00-325f-44a7-a82a-e42958857f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.643559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0dd00-325f-44a7-a82a-e42958857f87 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.643847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0dd00-325f-44a7-a82a-e42958857f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.644145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0dd00-325f-44a7-a82a-e42958857f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.648060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 811/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:48.651580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a79be-32d5-4243-b168-1b0dbbb7bbe1 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.657985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0dd00-325f-44a7-a82a-e42958857f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.659558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a79be-32d5-4243-b168-1b0dbbb7bbe1 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.659961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0dd00-325f-44a7-a82a-e42958857f87 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.665146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b9513-fbcc-4661-995f-7e68e2e77341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.666029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b9513-fbcc-4661-995f-7e68e2e77341 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.666337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b9513-fbcc-4661-995f-7e68e2e77341 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.666626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b9513-fbcc-4661-995f-7e68e2e77341 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.667339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b9513-fbcc-4661-995f-7e68e2e77341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.669313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b9513-fbcc-4661-995f-7e68e2e77341 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.675094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 808/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:48.676667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5cb96-7537-4a94-b4bf-eded840131d7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.676996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5cb96-7537-4a94-b4bf-eded840131d7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.677307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5cb96-7537-4a94-b4bf-eded840131d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.715092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-abc5cb96-7537-4a94-b4bf-eded840131d7 None None] MFA Rules not processed for user `b200c810e6114fd7a26c18817d8717fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:48.716735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-abc5cb96-7537-4a94-b4bf-eded840131d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:48.786925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:48.802424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 809/1620] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:48.802424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5cb96-7537-4a94-b4bf-eded840131d7 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.806362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 812/1621] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:48.808409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b9513-fbcc-4661-995f-7e68e2e77341 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.825324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5cb96-7537-4a94-b4bf-eded840131d7 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.828453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b9513-fbcc-4661-995f-7e68e2e77341 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.834699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74eca-2acf-494e-b48f-39b7d6cbd8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.835121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74eca-2acf-494e-b48f-39b7d6cbd8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.835405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74eca-2acf-494e-b48f-39b7d6cbd8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.835715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74eca-2acf-494e-b48f-39b7d6cbd8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.841743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5a8c4-6b9e-4f43-87d0-92a6ad8c56e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.842465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5a8c4-6b9e-4f43-87d0-92a6ad8c56e6 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.842740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5a8c4-6b9e-4f43-87d0-92a6ad8c56e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.843054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5a8c4-6b9e-4f43-87d0-92a6ad8c56e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.843718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5a8c4-6b9e-4f43-87d0-92a6ad8c56e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.845650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5a8c4-6b9e-4f43-87d0-92a6ad8c56e6 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.862195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74eca-2acf-494e-b48f-39b7d6cbd8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.863645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74eca-2acf-494e-b48f-39b7d6cbd8a9 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.894022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 810/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:48.894022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74eca-2acf-494e-b48f-39b7d6cbd8a9 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.894022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74eca-2acf-494e-b48f-39b7d6cbd8a9 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.905463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50791-ae19-4bbf-8ef4-9b9505990b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.906456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50791-ae19-4bbf-8ef4-9b9505990b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.906732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50791-ae19-4bbf-8ef4-9b9505990b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.907904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50791-ae19-4bbf-8ef4-9b9505990b57 admin admin] PATH_INFO: `/v3/projects/b8e22eb1658147beb78518d892198553/users/858ae85f11a043888b3bd797db75fa67/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.910475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50791-ae19-4bbf-8ef4-9b9505990b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e22eb1658147beb78518d892198553, user_id=858ae85f11a043888b3bd797db75fa67, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.915027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50791-ae19-4bbf-8ef4-9b9505990b57 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.927055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 811/1623] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:48 2022] PUT /identity/v3/projects/b8e22eb1658147beb78518d892198553/users/858ae85f11a043888b3bd797db75fa67/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:48.927893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50791-ae19-4bbf-8ef4-9b9505990b57 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.991275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 813/1624] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:48.992611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5a8c4-6b9e-4f43-87d0-92a6ad8c56e6 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.012704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50791-ae19-4bbf-8ef4-9b9505990b57 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.103468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:49.121443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5a8c4-6b9e-4f43-87d0-92a6ad8c56e6 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.127358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d936399-6397-440f-a3e4-5f0f6e82be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.128303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd12fe-1df8-4937-a4ae-8629dd0b1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.128840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd12fe-1df8-4937-a4ae-8629dd0b1aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.129140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd12fe-1df8-4937-a4ae-8629dd0b1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.129416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd12fe-1df8-4937-a4ae-8629dd0b1aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.130549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd12fe-1df8-4937-a4ae-8629dd0b1aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.130671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d936399-6397-440f-a3e4-5f0f6e82be55 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.130920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d936399-6397-440f-a3e4-5f0f6e82be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.131207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d936399-6397-440f-a3e4-5f0f6e82be55 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.131989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd12fe-1df8-4937-a4ae-8629dd0b1aa8 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.132092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d936399-6397-440f-a3e4-5f0f6e82be55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.137437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d936399-6397-440f-a3e4-5f0f6e82be55 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.145990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 814/1625] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:49.148406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f87a72-ee13-4fcd-a3ba-28ce0a0ff397 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.149489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f87a72-ee13-4fcd-a3ba-28ce0a0ff397 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.149974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f87a72-ee13-4fcd-a3ba-28ce0a0ff397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.183586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-57f87a72-ee13-4fcd-a3ba-28ce0a0ff397 None None] MFA Rules not processed for user `858ae85f11a043888b3bd797db75fa67`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:49.184804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-57f87a72-ee13-4fcd-a3ba-28ce0a0ff397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:49.264773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 815/1626] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:49.265715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f87a72-ee13-4fcd-a3ba-28ce0a0ff397 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.281856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f87a72-ee13-4fcd-a3ba-28ce0a0ff397 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.285860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86785c-21c5-450b-bd3a-8f2f21876bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.286577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86785c-21c5-450b-bd3a-8f2f21876bcb admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.286866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86785c-21c5-450b-bd3a-8f2f21876bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.287150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86785c-21c5-450b-bd3a-8f2f21876bcb admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.287990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86785c-21c5-450b-bd3a-8f2f21876bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.290004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86785c-21c5-450b-bd3a-8f2f21876bcb admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.311827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 812/1627] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/projects => generated 375 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:49.312843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d936399-6397-440f-a3e4-5f0f6e82be55 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.376986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 816/1628] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:49 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:49.378327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86785c-21c5-450b-bd3a-8f2f21876bcb admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.441908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d936399-6397-440f-a3e4-5f0f6e82be55 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.447721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6349e8-51f5-4bb2-9429-cb64a2194995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.448866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6349e8-51f5-4bb2-9429-cb64a2194995 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.449244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6349e8-51f5-4bb2-9429-cb64a2194995 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.449592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6349e8-51f5-4bb2-9429-cb64a2194995 admin admin] PATH_INFO: `/v3/projects/f2c5af6b3cde4e94b566faa08c5810ee/users/28e125c83bd9459384ff64b582d55303/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.454450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:49.467363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86785c-21c5-450b-bd3a-8f2f21876bcb admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.470991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6349e8-51f5-4bb2-9429-cb64a2194995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c5af6b3cde4e94b566faa08c5810ee, user_id=28e125c83bd9459384ff64b582d55303, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.474300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6349e8-51f5-4bb2-9429-cb64a2194995 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.582357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 813/1629] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:49 2022] PUT /identity/v3/projects/f2c5af6b3cde4e94b566faa08c5810ee/users/28e125c83bd9459384ff64b582d55303/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:49.582357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6349e8-51f5-4bb2-9429-cb64a2194995 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.583212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868234b-acc7-442d-9522-8c24a8ca3a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.583894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868234b-acc7-442d-9522-8c24a8ca3a5a service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.584188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868234b-acc7-442d-9522-8c24a8ca3a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.584471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868234b-acc7-442d-9522-8c24a8ca3a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.649913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:49.691634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868234b-acc7-442d-9522-8c24a8ca3a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.693556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868234b-acc7-442d-9522-8c24a8ca3a5a service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.708529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 817/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:49.709677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868234b-acc7-442d-9522-8c24a8ca3a5a service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.725164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868234b-acc7-442d-9522-8c24a8ca3a5a service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.729744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fddc0-51c8-4ed2-ac51-253e8c788b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.730387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6349e8-51f5-4bb2-9429-cb64a2194995 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.731865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fddc0-51c8-4ed2-ac51-253e8c788b5b admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.732360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fddc0-51c8-4ed2-ac51-253e8c788b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.733602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fddc0-51c8-4ed2-ac51-253e8c788b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.734695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fddc0-51c8-4ed2-ac51-253e8c788b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.735852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696226aa-bce2-4de7-9c9f-942fae2d4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.736723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696226aa-bce2-4de7-9c9f-942fae2d4b08 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.737035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696226aa-bce2-4de7-9c9f-942fae2d4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.737393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696226aa-bce2-4de7-9c9f-942fae2d4b08 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.738396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696226aa-bce2-4de7-9c9f-942fae2d4b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.738942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fddc0-51c8-4ed2-ac51-253e8c788b5b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.741102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696226aa-bce2-4de7-9c9f-942fae2d4b08 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.770395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 818/1631] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:49.772492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fddc0-51c8-4ed2-ac51-253e8c788b5b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.797447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fddc0-51c8-4ed2-ac51-253e8c788b5b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.804763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a73e75-0911-4917-b0ad-a8644bcbb0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.806008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a73e75-0911-4917-b0ad-a8644bcbb0de admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.806355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a73e75-0911-4917-b0ad-a8644bcbb0de admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.807195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a73e75-0911-4917-b0ad-a8644bcbb0de admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.807881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a73e75-0911-4917-b0ad-a8644bcbb0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.810087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a73e75-0911-4917-b0ad-a8644bcbb0de admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.825430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 819/1632] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:49.826062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a73e75-0911-4917-b0ad-a8644bcbb0de admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.841284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a73e75-0911-4917-b0ad-a8644bcbb0de admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.843217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b155025-0c01-4bd6-81ca-962bb3bcbd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.844127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155025-0c01-4bd6-81ca-962bb3bcbd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.844687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155025-0c01-4bd6-81ca-962bb3bcbd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.844975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155025-0c01-4bd6-81ca-962bb3bcbd07 admin admin] PATH_INFO: `/v3/projects/6af4f06d50c04c37bf2d242531de5570/users/3a20d2cfa29c4dbe9e401935267fe1f0/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.862380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 814/1633] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:49 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:49.863359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696226aa-bce2-4de7-9c9f-942fae2d4b08 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.866344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b155025-0c01-4bd6-81ca-962bb3bcbd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af4f06d50c04c37bf2d242531de5570, user_id=3a20d2cfa29c4dbe9e401935267fe1f0, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.869468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b155025-0c01-4bd6-81ca-962bb3bcbd07 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.877600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696226aa-bce2-4de7-9c9f-942fae2d4b08 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.882838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9f5d0-f352-4e4d-841b-cf692423ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.884348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9f5d0-f352-4e4d-841b-cf692423ce38 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.884691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9f5d0-f352-4e4d-841b-cf692423ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.884966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9f5d0-f352-4e4d-841b-cf692423ce38 admin admin] PATH_INFO: `/v3/projects/f2c5af6b3cde4e94b566faa08c5810ee/users/28e125c83bd9459384ff64b582d55303/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.887259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9f5d0-f352-4e4d-841b-cf692423ce38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c5af6b3cde4e94b566faa08c5810ee, user_id=28e125c83bd9459384ff64b582d55303, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.890569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9f5d0-f352-4e4d-841b-cf692423ce38 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.902883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 815/1634] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:49 2022] PUT /identity/v3/projects/f2c5af6b3cde4e94b566faa08c5810ee/users/28e125c83bd9459384ff64b582d55303/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:49.915856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9f5d0-f352-4e4d-841b-cf692423ce38 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.003936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 820/1635] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:49 2022] PUT /identity/v3/projects/6af4f06d50c04c37bf2d242531de5570/users/3a20d2cfa29c4dbe9e401935267fe1f0/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:50.011804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef42363-b132-4b2c-8f00-d407fec9449f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.013196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef42363-b132-4b2c-8f00-d407fec9449f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.014120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef42363-b132-4b2c-8f00-d407fec9449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.025037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9f5d0-f352-4e4d-841b-cf692423ce38 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.067737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1ef42363-b132-4b2c-8f00-d407fec9449f None None] MFA Rules not processed for user `28e125c83bd9459384ff64b582d55303`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:50.069313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1ef42363-b132-4b2c-8f00-d407fec9449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:50.109777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ac32-a45c-4d3d-8fa6-14ebcc5e9c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.111105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ac32-a45c-4d3d-8fa6-14ebcc5e9c86 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.111393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ac32-a45c-4d3d-8fa6-14ebcc5e9c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.111674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ac32-a45c-4d3d-8fa6-14ebcc5e9c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.112993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ac32-a45c-4d3d-8fa6-14ebcc5e9c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.116537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ac32-a45c-4d3d-8fa6-14ebcc5e9c86 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.133887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 816/1636] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:50.133887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ac32-a45c-4d3d-8fa6-14ebcc5e9c86 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.152972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ac32-a45c-4d3d-8fa6-14ebcc5e9c86 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.160667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e12d-66c2-4074-bac7-f738eb87543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.162909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e12d-66c2-4074-bac7-f738eb87543e admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.163361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e12d-66c2-4074-bac7-f738eb87543e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.163895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e12d-66c2-4074-bac7-f738eb87543e admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.165742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9e12d-66c2-4074-bac7-f738eb87543e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.168911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9e12d-66c2-4074-bac7-f738eb87543e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.188149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 817/1637] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:50.190645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e12d-66c2-4074-bac7-f738eb87543e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.191300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 821/1638] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:50.192186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef42363-b132-4b2c-8f00-d407fec9449f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.213224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e12d-66c2-4074-bac7-f738eb87543e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.218017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef42363-b132-4b2c-8f00-d407fec9449f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.219178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9426f5-697c-4ebc-be65-dd8918f7e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.220315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9426f5-697c-4ebc-be65-dd8918f7e2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.220987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9426f5-697c-4ebc-be65-dd8918f7e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.222382 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9426f5-697c-4ebc-be65-dd8918f7e2a5 admin admin] PATH_INFO: `/v3/projects/17b6af816df640d282a5b353fab11eec/users/54e26fe6a43b49dcb776c92894ed56f6/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.242013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef42fa-b571-4a64-96b2-eb19dfbdd237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.243621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef42fa-b571-4a64-96b2-eb19dfbdd237 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.243917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef42fa-b571-4a64-96b2-eb19dfbdd237 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.244295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef42fa-b571-4a64-96b2-eb19dfbdd237 admin admin] PATH_INFO: `/v3/projects/6af4f06d50c04c37bf2d242531de5570/users/3a20d2cfa29c4dbe9e401935267fe1f0/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.246702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9426f5-697c-4ebc-be65-dd8918f7e2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b6af816df640d282a5b353fab11eec, user_id=54e26fe6a43b49dcb776c92894ed56f6, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.250420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9426f5-697c-4ebc-be65-dd8918f7e2a5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.251019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef42fa-b571-4a64-96b2-eb19dfbdd237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af4f06d50c04c37bf2d242531de5570, user_id=3a20d2cfa29c4dbe9e401935267fe1f0, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.254168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef42fa-b571-4a64-96b2-eb19dfbdd237 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.274505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 822/1639] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:50 2022] PUT /identity/v3/projects/6af4f06d50c04c37bf2d242531de5570/users/3a20d2cfa29c4dbe9e401935267fe1f0/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:50.292228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef42fa-b571-4a64-96b2-eb19dfbdd237 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.297943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:50.338571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 818/1640] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:50 2022] PUT /identity/v3/projects/17b6af816df640d282a5b353fab11eec/users/54e26fe6a43b49dcb776c92894ed56f6/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:50.346095 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11991351-8731-4c7a-8568-720e1f9d2313 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.346409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11991351-8731-4c7a-8568-720e1f9d2313 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.349345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11991351-8731-4c7a-8568-720e1f9d2313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.400755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef42fa-b571-4a64-96b2-eb19dfbdd237 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.417710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-11991351-8731-4c7a-8568-720e1f9d2313 None None] MFA Rules not processed for user `3a20d2cfa29c4dbe9e401935267fe1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:50.417928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-11991351-8731-4c7a-8568-720e1f9d2313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:50.522269 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 819/1641] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:50.523228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11991351-8731-4c7a-8568-720e1f9d2313 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.560513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfedd7-cdbc-44bb-9a08-6c61d042dc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.561367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfedd7-cdbc-44bb-9a08-6c61d042dc41 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.561657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfedd7-cdbc-44bb-9a08-6c61d042dc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.561932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfedd7-cdbc-44bb-9a08-6c61d042dc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.611044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11991351-8731-4c7a-8568-720e1f9d2313 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.617142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32c71-8bb6-4750-8272-229c02b99303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.618217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32c71-8bb6-4750-8272-229c02b99303 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.618550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32c71-8bb6-4750-8272-229c02b99303 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.618889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32c71-8bb6-4750-8272-229c02b99303 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.619779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c32c71-8bb6-4750-8272-229c02b99303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.622496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c32c71-8bb6-4750-8272-229c02b99303 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.637003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 820/1642] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:50.639098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32c71-8bb6-4750-8272-229c02b99303 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.654083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32c71-8bb6-4750-8272-229c02b99303 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.667928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3da96-4624-48f3-b2ce-1ee2969337ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.667928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3da96-4624-48f3-b2ce-1ee2969337ff service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.667928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3da96-4624-48f3-b2ce-1ee2969337ff service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.667928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3da96-4624-48f3-b2ce-1ee2969337ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.668398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:50.671209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfedd7-cdbc-44bb-9a08-6c61d042dc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.672890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfedd7-cdbc-44bb-9a08-6c61d042dc41 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.692176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 823/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:50.699820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfedd7-cdbc-44bb-9a08-6c61d042dc41 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.722781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfedd7-cdbc-44bb-9a08-6c61d042dc41 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.733614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fb2ba-bc91-42ef-8df1-dff3ae527c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.734470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fb2ba-bc91-42ef-8df1-dff3ae527c4c service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.734949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fb2ba-bc91-42ef-8df1-dff3ae527c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.735101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fb2ba-bc91-42ef-8df1-dff3ae527c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.760887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fb2ba-bc91-42ef-8df1-dff3ae527c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.766337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fb2ba-bc91-42ef-8df1-dff3ae527c4c service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.785646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 824/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:50.786742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fb2ba-bc91-42ef-8df1-dff3ae527c4c service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:50.787544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3da96-4624-48f3-b2ce-1ee2969337ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.789395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3da96-4624-48f3-b2ce-1ee2969337ff service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.798053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fb2ba-bc91-42ef-8df1-dff3ae527c4c service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:50.803763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddaf8a-b931-467f-a68b-3969dbf215ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:50.803972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 821/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:50.804994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddaf8a-b931-467f-a68b-3969dbf215ca admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.805342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddaf8a-b931-467f-a68b-3969dbf215ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.805685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddaf8a-b931-467f-a68b-3969dbf215ca admin admin] PATH_INFO: `/v3/projects/17b6af816df640d282a5b353fab11eec/users/54e26fe6a43b49dcb776c92894ed56f6/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.807984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddaf8a-b931-467f-a68b-3969dbf215ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b6af816df640d282a5b353fab11eec, user_id=54e26fe6a43b49dcb776c92894ed56f6, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:50.810793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddaf8a-b931-467f-a68b-3969dbf215ca admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:50.826773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 825/1646] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:50 2022] PUT /identity/v3/projects/17b6af816df640d282a5b353fab11eec/users/54e26fe6a43b49dcb776c92894ed56f6/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:50.839438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37759-f426-43b5-aad1-39970623566b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:50.846482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37759-f426-43b5-aad1-39970623566b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:50.846482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37759-f426-43b5-aad1-39970623566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:50.878742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-e1c37759-f426-43b5-aad1-39970623566b None None] MFA Rules not processed for user `54e26fe6a43b49dcb776c92894ed56f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:50.879883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e1c37759-f426-43b5-aad1-39970623566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:51.055391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 822/1647] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:51.136080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddaf8a-b931-467f-a68b-3969dbf215ca admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:51.249936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddaf8a-b931-467f-a68b-3969dbf215ca admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:51.259888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20873e65-54b4-42f4-a6f5-cf159aabe566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:51.260960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873e65-54b4-42f4-a6f5-cf159aabe566 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:51.261459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873e65-54b4-42f4-a6f5-cf159aabe566 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:51.261954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873e65-54b4-42f4-a6f5-cf159aabe566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:51.287523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20873e65-54b4-42f4-a6f5-cf159aabe566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:51.291303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20873e65-54b4-42f4-a6f5-cf159aabe566 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:51.320106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 826/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:51.366514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:54.681703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311a65-45cb-460e-9dc1-044d0ee2d28b None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:54.682508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311a65-45cb-460e-9dc1-044d0ee2d28b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:54.682508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311a65-45cb-460e-9dc1-044d0ee2d28b None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:54.684415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 823/1649] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 14:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:51:54.856702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979a35-6e8b-4399-8ae0-aef825da19ce None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:54.857316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979a35-6e8b-4399-8ae0-aef825da19ce None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:54.857316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979a35-6e8b-4399-8ae0-aef825da19ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:54.895455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1d979a35-6e8b-4399-8ae0-aef825da19ce None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:54.896708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1d979a35-6e8b-4399-8ae0-aef825da19ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:54.952179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:55.065481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 827/1650] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:55.103743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311a65-45cb-460e-9dc1-044d0ee2d28b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:55.159912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311a65-45cb-460e-9dc1-044d0ee2d28b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:55.169390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83979deb-3fc4-410b-ab4c-261b294822d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:55.170605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83979deb-3fc4-410b-ab4c-261b294822d4 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:55.171285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83979deb-3fc4-410b-ab4c-261b294822d4 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:55.173069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83979deb-3fc4-410b-ab4c-261b294822d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:55.184763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83979deb-3fc4-410b-ab4c-261b294822d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:55.198689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83979deb-3fc4-410b-ab4c-261b294822d4 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:55.265936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 824/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:56.310636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d979a35-6e8b-4399-8ae0-aef825da19ce None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:56.393276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d979a35-6e8b-4399-8ae0-aef825da19ce None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:56.399176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:56.404717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:56.404717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:56.404717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] PATH_INFO: `/v3/users/0788bf035cee4dbd93c77ae96e9c001d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:56.404717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0788bf035cee4dbd93c77ae96e9c001d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:56.404717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:56.655687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0788bf035cee4dbd93c77ae96e9c001d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.745749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0788bf035cee4dbd93c77ae96e9c001d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.780397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0788bf035cee4dbd93c77ae96e9c001d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.796261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0788bf035cee4dbd93c77ae96e9c001d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.803537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0788bf035cee4dbd93c77ae96e9c001d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.821695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0db86-02a7-4fc3-a5d7-99e0ace63c10 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:56.822339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0db86-02a7-4fc3-a5d7-99e0ace63c10 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:56.822339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0db86-02a7-4fc3-a5d7-99e0ace63c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:56.822531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 828/1652] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:56 2022] DELETE /identity/v3/users/0788bf035cee4dbd93c77ae96e9c001d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:56.855028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-dcf0db86-02a7-4fc3-a5d7-99e0ace63c10 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:56.858905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-dcf0db86-02a7-4fc3-a5d7-99e0ace63c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:56.975164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 825/1653] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:56.997976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:57.003777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:57.208981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaacd2-320f-4350-a7a0-97d57f285257 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:57.214092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342342f3-ab52-42e1-a009-f835f6ce8e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:57.215264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342342f3-ab52-42e1-a009-f835f6ce8e71 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:57.216362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342342f3-ab52-42e1-a009-f835f6ce8e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:57.217017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342342f3-ab52-42e1-a009-f835f6ce8e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:57.231382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:57.234175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342342f3-ab52-42e1-a009-f835f6ce8e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:57.241067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342342f3-ab52-42e1-a009-f835f6ce8e71 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:57.253153 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 829/1654] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:58.889381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0db86-02a7-4fc3-a5d7-99e0ace63c10 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:58.893430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-dcf0db86-02a7-4fc3-a5d7-99e0ace63c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:58.954549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0db86-02a7-4fc3-a5d7-99e0ace63c10 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:58.973243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:58.977720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:58.978075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:58.978400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] PATH_INFO: `/v3/projects/eece26c59ff041b8b249c3a586a72236` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:58.984143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eece26c59ff041b8b249c3a586a72236)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:58.989945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:59.184382 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eece26c59ff041b8b249c3a586a72236', 'request_id': 'req-aa58443d-2a08-4e51-aa61-743567484ef1'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:59.188675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:59.263188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eece26c59ff041b8b249c3a586a72236', 'request_id': 'req-aa58443d-2a08-4e51-aa61-743567484ef1'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:59.272391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eece26c59ff041b8b249c3a586a72236', 'request_id': 'req-aa58443d-2a08-4e51-aa61-743567484ef1'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:59.301803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] The token cache is being invalidate because project eece26c59ff041b8b249c3a586a72236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:59.313022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:59.316908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:59.329014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 826/1655] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:58 2022] DELETE /identity/v3/projects/eece26c59ff041b8b249c3a586a72236 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:59.332826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342342f3-ab52-42e1-a009-f835f6ce8e71 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:59.354851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342342f3-ab52-42e1-a009-f835f6ce8e71 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:59.555239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:59.556819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:59.557308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:59.559467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] PATH_INFO: `/v3/users/3a20d2cfa29c4dbe9e401935267fe1f0` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:59.561037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a20d2cfa29c4dbe9e401935267fe1f0)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:59.564165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:00.095100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a20d2cfa29c4dbe9e401935267fe1f0'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:00.166068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a20d2cfa29c4dbe9e401935267fe1f0'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:00.190243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a20d2cfa29c4dbe9e401935267fe1f0'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:00.207011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a20d2cfa29c4dbe9e401935267fe1f0'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:00.207011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1bcb565e-0ec9-4cd4-b920-38e22310bcaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a20d2cfa29c4dbe9e401935267fe1f0'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:00.219655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 830/1656] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:59 2022] DELETE /identity/v3/users/3a20d2cfa29c4dbe9e401935267fe1f0 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:00.392903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:00.394475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:00.422211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58443d-2a08-4e51-aa61-743567484ef1 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:00.564497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:00.565412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:00.565697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:00.567179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] PATH_INFO: `/v3/users/86fa57fa21584714b5c1094afdd291d4` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:00.573228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fa57fa21584714b5c1094afdd291d4)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:00.574733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING py.warnings [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:52:00.574733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: warnings.warn(msg) Jul 11 14:52:00.574733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: Jul 11 14:52:00.579029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:00.856452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fa57fa21584714b5c1094afdd291d4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:00.981137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fa57fa21584714b5c1094afdd291d4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:01.029705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fa57fa21584714b5c1094afdd291d4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:01.031149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fa57fa21584714b5c1094afdd291d4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:01.053833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fa57fa21584714b5c1094afdd291d4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:01.063979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 827/1657] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:00 2022] DELETE /identity/v3/users/86fa57fa21584714b5c1094afdd291d4 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:01.068702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bb827-d5cc-4ed0-b25f-4d3bca5de986 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:01.069254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bb827-d5cc-4ed0-b25f-4d3bca5de986 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:01.069488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bb827-d5cc-4ed0-b25f-4d3bca5de986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:01.109455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b14bb827-d5cc-4ed0-b25f-4d3bca5de986 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:01.110890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b14bb827-d5cc-4ed0-b25f-4d3bca5de986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:01.235767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 831/1658] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:01.252496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:01.254798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:01.432044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c67a6-3a79-4210-b1ba-775ade9c8687 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:01.446418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:01.448505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:01.449094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:01.452262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:01.464262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df368126-1d40-46a2-bc68-250536c0f688 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:01.464568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df368126-1d40-46a2-bc68-250536c0f688 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:01.464944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df368126-1d40-46a2-bc68-250536c0f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:01.511822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:01.516719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:01.539696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:01.555560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-df368126-1d40-46a2-bc68-250536c0f688 None None] MFA Rules not processed for user `e53d0c7429474cfc84570a9d2e61605a`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:01.555560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-df368126-1d40-46a2-bc68-250536c0f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:01.567069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 828/1659] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:01.567751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:01.575429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:01.638300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:01.652742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee075-b5ad-441b-82a4-f974cabf1094 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:01.677636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:01.678834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:01.681117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:01.681117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] PATH_INFO: `/v3/projects/6af4f06d50c04c37bf2d242531de5570` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:01.682540 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af4f06d50c04c37bf2d242531de5570)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:01.689114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:01.773575 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 832/1660] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:01.814389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c43e-ac5d-401d-af7a-e6a9ff67461b None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:01.814715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c43e-ac5d-401d-af7a-e6a9ff67461b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:01.814973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c43e-ac5d-401d-af7a-e6a9ff67461b None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:01.816822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 833/1661] 10.222.0.20 () {54 vars in 961 bytes} [Mon Jul 11 14:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:52:01.836200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484865-7c4b-4a3d-b19a-34a5ae94961b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:01.836590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484865-7c4b-4a3d-b19a-34a5ae94961b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:01.836763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484865-7c4b-4a3d-b19a-34a5ae94961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:01.919641 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af4f06d50c04c37bf2d242531de5570', 'request_id': 'req-661e1c93-9500-4e70-b164-5f3692d2ba77'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:01.957722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-99484865-7c4b-4a3d-b19a-34a5ae94961b None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:01.958558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-99484865-7c4b-4a3d-b19a-34a5ae94961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:02.001217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af4f06d50c04c37bf2d242531de5570', 'request_id': 'req-661e1c93-9500-4e70-b164-5f3692d2ba77'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:02.010515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af4f06d50c04c37bf2d242531de5570', 'request_id': 'req-661e1c93-9500-4e70-b164-5f3692d2ba77'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:02.046888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] The token cache is being invalidate because project 6af4f06d50c04c37bf2d242531de5570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:02.047452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:02.049253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-661e1c93-9500-4e70-b164-5f3692d2ba77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:02.055876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 829/1662] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:01 2022] DELETE /identity/v3/projects/6af4f06d50c04c37bf2d242531de5570 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:02.063656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d64ad-96e2-46f1-9084-f1058fad04a7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:02.063656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d64ad-96e2-46f1-9084-f1058fad04a7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:02.063656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d64ad-96e2-46f1-9084-f1058fad04a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:02.099414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-603d64ad-96e2-46f1-9084-f1058fad04a7 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:02.105334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-603d64ad-96e2-46f1-9084-f1058fad04a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:02.114469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 834/1663] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jul 11 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:02.128847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99484865-7c4b-4a3d-b19a-34a5ae94961b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:02.155437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99484865-7c4b-4a3d-b19a-34a5ae94961b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:02.168338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:02.171333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:02.172411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:02.172411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:02.176262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:02.259861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 830/1664] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:02.266040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64a4a-a19b-4a10-bf57-2d913424f767 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:02.267421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64a4a-a19b-4a10-bf57-2d913424f767 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:02.268263 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64a4a-a19b-4a10-bf57-2d913424f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:02.311767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-06b64a4a-a19b-4a10-bf57-2d913424f767 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:02.313092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-06b64a4a-a19b-4a10-bf57-2d913424f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:02.325539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:02.328310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:02.339331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 831/1665] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:02.342351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64a4a-a19b-4a10-bf57-2d913424f767 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:02.353449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 835/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:52:02.357518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64a4a-a19b-4a10-bf57-2d913424f767 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:02.362725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:02.363398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:02.363682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:02.363964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:02.364694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:02.365134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:02.367623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:02.382188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 832/1667] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:02.386292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:02.400500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23193725-dd03-4912-9884-5d4391cda1d5 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:02.422312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf9db9-2b0b-4483-9526-246fd8cbb181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:02.423827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9db9-2b0b-4483-9526-246fd8cbb181 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:02.424942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9db9-2b0b-4483-9526-246fd8cbb181 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:02.425304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9db9-2b0b-4483-9526-246fd8cbb181 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:02.427361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf9db9-2b0b-4483-9526-246fd8cbb181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:02.433005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf9db9-2b0b-4483-9526-246fd8cbb181 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:02.573807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:02.593994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 836/1668] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:02 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:02.595205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:02.610484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a778e-ade0-4540-986d-9706d26b4c3a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:02.771477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7568-2f9a-4b24-ab35-9c404524be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:02.772354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7568-2f9a-4b24-ab35-9c404524be76 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:02.772646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7568-2f9a-4b24-ab35-9c404524be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:02.772926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7568-2f9a-4b24-ab35-9c404524be76 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:02.775211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd7568-2f9a-4b24-ab35-9c404524be76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:02.778804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd7568-2f9a-4b24-ab35-9c404524be76 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:02.808798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:02.892109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 833/1669] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:02 2022] POST /identity/v3/users => generated 296 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:02.893367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf9db9-2b0b-4483-9526-246fd8cbb181 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:02.918904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf9db9-2b0b-4483-9526-246fd8cbb181 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:02.924211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfcfe5-21b3-4171-8160-53feb3f13e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:02.924917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfcfe5-21b3-4171-8160-53feb3f13e60 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:02.925210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfcfe5-21b3-4171-8160-53feb3f13e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:02.925540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfcfe5-21b3-4171-8160-53feb3f13e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:02.926290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfcfe5-21b3-4171-8160-53feb3f13e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:02.927951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfcfe5-21b3-4171-8160-53feb3f13e60 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:02.956652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 837/1670] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:02.957859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7568-2f9a-4b24-ab35-9c404524be76 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:02.969184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7568-2f9a-4b24-ab35-9c404524be76 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:02.988415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:02.989137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:02.989404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:02.989833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:02.990768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:02.992967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:03.038579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 834/1671] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:03.042601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfcfe5-21b3-4171-8160-53feb3f13e60 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:03.060256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfcfe5-21b3-4171-8160-53feb3f13e60 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:03.068587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b481dda-910d-47f6-a596-9d510e804723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:03.071984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b481dda-910d-47f6-a596-9d510e804723 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:03.072445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b481dda-910d-47f6-a596-9d510e804723 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:03.073657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b481dda-910d-47f6-a596-9d510e804723 admin admin] PATH_INFO: `/v3/projects/f3c73473b4e94c0cbc6032d596a6bd9a/users/a89e917831d8415faab036f4326d36b2/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:03.108297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b481dda-910d-47f6-a596-9d510e804723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c73473b4e94c0cbc6032d596a6bd9a, user_id=a89e917831d8415faab036f4326d36b2, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:03.111697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b481dda-910d-47f6-a596-9d510e804723 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:03.146431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:03.146431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:03.193600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c175e3-859b-4d54-8e0c-0cdf1f117092 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:03.212610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:03.214505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:03.216334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:03.217319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] PATH_INFO: `/v3/projects/664b410ad3454d46adab1bf66a0d75df` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:03.220978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664b410ad3454d46adab1bf66a0d75df)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:03.224659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:03.240037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 838/1672] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:03 2022] PUT /identity/v3/projects/f3c73473b4e94c0cbc6032d596a6bd9a/users/a89e917831d8415faab036f4326d36b2/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:03.252211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856305-2cbd-4c9e-860b-445326c0c23d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:03.252662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856305-2cbd-4c9e-860b-445326c0c23d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:03.252769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856305-2cbd-4c9e-860b-445326c0c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:03.310327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-62856305-2cbd-4c9e-860b-445326c0c23d None None] MFA Rules not processed for user `a89e917831d8415faab036f4326d36b2`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:03.311619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-62856305-2cbd-4c9e-860b-445326c0c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:03.441481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 839/1673] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:03.460975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664b410ad3454d46adab1bf66a0d75df', 'request_id': 'req-4f406d05-36f5-429e-aa9b-32e3705fb851'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:03.538786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856305-2cbd-4c9e-860b-445326c0c23d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:03.540446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-62856305-2cbd-4c9e-860b-445326c0c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:03.569438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664b410ad3454d46adab1bf66a0d75df', 'request_id': 'req-4f406d05-36f5-429e-aa9b-32e3705fb851'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:03.580358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664b410ad3454d46adab1bf66a0d75df', 'request_id': 'req-4f406d05-36f5-429e-aa9b-32e3705fb851'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:03.606083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] The token cache is being invalidate because project 664b410ad3454d46adab1bf66a0d75df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:03.608106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:03.611906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:03.617387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 835/1674] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:03 2022] DELETE /identity/v3/projects/664b410ad3454d46adab1bf66a0d75df => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:03.621551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:03.624091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:03.689768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856305-2cbd-4c9e-860b-445326c0c23d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:03.838502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406d05-36f5-429e-aa9b-32e3705fb851 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:03.847718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:03.854437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:03.854437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:03.854437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:03.854673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:03.854748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:03.854817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:03.854817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] PATH_INFO: `/v3/users/28e125c83bd9459384ff64b582d55303` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:03.857241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:03.858069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e125c83bd9459384ff64b582d55303)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:03.863880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:03.933112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:04.044566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:04.046293 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:04.064484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 840/1675] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:52:04.097667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:04.099149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:04.131975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923b776-45ec-4e89-9625-00baf38429df service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:04.143201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:04.144113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:04.144393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:04.144666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] PATH_INFO: `/v3/users/a89e917831d8415faab036f4326d36b2` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:04.146862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89e917831d8415faab036f4326d36b2)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:04.148922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:04.157294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e125c83bd9459384ff64b582d55303'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.265998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e125c83bd9459384ff64b582d55303'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.306465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:04.308952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e125c83bd9459384ff64b582d55303'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.309865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e125c83bd9459384ff64b582d55303'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.336218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-789db88b-2dd3-4778-a368-d6a414aadd80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e125c83bd9459384ff64b582d55303'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.369748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 836/1676] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:03 2022] DELETE /identity/v3/users/28e125c83bd9459384ff64b582d55303 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:04.464753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89e917831d8415faab036f4326d36b2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.551346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89e917831d8415faab036f4326d36b2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.585149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89e917831d8415faab036f4326d36b2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.596318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89e917831d8415faab036f4326d36b2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.597243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89e917831d8415faab036f4326d36b2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:04.608783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 841/1677] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:04 2022] DELETE /identity/v3/users/a89e917831d8415faab036f4326d36b2 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:04.621285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604442f4-c819-4ef8-8e92-561f8cc87a0b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:04.621285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604442f4-c819-4ef8-8e92-561f8cc87a0b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:04.621285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604442f4-c819-4ef8-8e92-561f8cc87a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:04.663151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-604442f4-c819-4ef8-8e92-561f8cc87a0b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:04.664962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-604442f4-c819-4ef8-8e92-561f8cc87a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:04.794835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 837/1678] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:04.889936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:04.891819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:05.017041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f1304-b074-46cb-a233-09102b249719 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:05.051340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:05.051340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:05.051340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:05.051340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:05.069037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:05.071086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:05.099485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 842/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:06.484712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604442f4-c819-4ef8-8e92-561f8cc87a0b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:06.486810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-604442f4-c819-4ef8-8e92-561f8cc87a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:06.504933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604442f4-c819-4ef8-8e92-561f8cc87a0b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:06.518542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:06.519690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:06.520064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:06.520539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] PATH_INFO: `/v3/projects/f2c5af6b3cde4e94b566faa08c5810ee` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:06.522832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c5af6b3cde4e94b566faa08c5810ee)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:06.527966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:06.556399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:06.558614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:06.583896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca9fc-1349-4fe2-82c3-611f65ea3309 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:06.592354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:06.593262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:06.593554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:06.593840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] PATH_INFO: `/v3/projects/f3c73473b4e94c0cbc6032d596a6bd9a` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:06.597875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c73473b4e94c0cbc6032d596a6bd9a)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:06.599020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: WARNING py.warnings [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:52:06.599020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: warnings.warn(msg) Jul 11 14:52:06.599020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: Jul 11 14:52:06.600259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:06.667769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c5af6b3cde4e94b566faa08c5810ee', 'request_id': 'req-c96e3941-79ca-45ca-a819-f7e7d802799f'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.765021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:06.777363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c5af6b3cde4e94b566faa08c5810ee', 'request_id': 'req-c96e3941-79ca-45ca-a819-f7e7d802799f'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.786482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c5af6b3cde4e94b566faa08c5810ee', 'request_id': 'req-c96e3941-79ca-45ca-a819-f7e7d802799f'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.793184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c73473b4e94c0cbc6032d596a6bd9a', 'request_id': 'req-bf0f7938-719c-493c-853a-a9824ddcf35f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.836913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] The token cache is being invalidate because project f2c5af6b3cde4e94b566faa08c5810ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:06.837106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.840196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c96e3941-79ca-45ca-a819-f7e7d802799f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.852855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 838/1680] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:06 2022] DELETE /identity/v3/projects/f2c5af6b3cde4e94b566faa08c5810ee => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:06.854367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aba7b-2a34-44a2-9dda-3ad5bbb3031c None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:06.854868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aba7b-2a34-44a2-9dda-3ad5bbb3031c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:06.855483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aba7b-2a34-44a2-9dda-3ad5bbb3031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:06.877983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a05aba7b-2a34-44a2-9dda-3ad5bbb3031c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:06.880048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a05aba7b-2a34-44a2-9dda-3ad5bbb3031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:06.885537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c73473b4e94c0cbc6032d596a6bd9a', 'request_id': 'req-bf0f7938-719c-493c-853a-a9824ddcf35f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.924149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c73473b4e94c0cbc6032d596a6bd9a', 'request_id': 'req-bf0f7938-719c-493c-853a-a9824ddcf35f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.958547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] The token cache is being invalidate because project f3c73473b4e94c0cbc6032d596a6bd9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:06.958863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.963708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bf0f7938-719c-493c-853a-a9824ddcf35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:06.969064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 843/1681] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:06 2022] DELETE /identity/v3/projects/f3c73473b4e94c0cbc6032d596a6bd9a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:06.970813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61795-19b6-4b3f-afa6-6ecc08c68738 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:06.971198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61795-19b6-4b3f-afa6-6ecc08c68738 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:06.971791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61795-19b6-4b3f-afa6-6ecc08c68738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:06.981316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 839/1682] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:06.988081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896f0b-822c-43bb-bcc7-4c40394d29cb None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:06.988489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896f0b-822c-43bb-bcc7-4c40394d29cb None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:06.988876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896f0b-822c-43bb-bcc7-4c40394d29cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.010376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c4a61795-19b6-4b3f-afa6-6ecc08c68738 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:07.012127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c4a61795-19b6-4b3f-afa6-6ecc08c68738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:07.030868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 844/1683] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:07.039166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99e49-efb9-41e1-83f7-4d5a8bcfe5d1 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.039819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99e49-efb9-41e1-83f7-4d5a8bcfe5d1 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.040304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99e49-efb9-41e1-83f7-4d5a8bcfe5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.048636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-6c896f0b-822c-43bb-bcc7-4c40394d29cb None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:07.049862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6c896f0b-822c-43bb-bcc7-4c40394d29cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:07.064939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-bea99e49-efb9-41e1-83f7-4d5a8bcfe5d1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:07.066737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bea99e49-efb9-41e1-83f7-4d5a8bcfe5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:07.076999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 840/1684] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:07.079248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896f0b-822c-43bb-bcc7-4c40394d29cb None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.092660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:07.097946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896f0b-822c-43bb-bcc7-4c40394d29cb None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.100577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 845/1685] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:07.106925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea99e49-efb9-41e1-83f7-4d5a8bcfe5d1 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.110594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.111285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.111565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.112036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.112613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:07.112893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.114807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.129869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea99e49-efb9-41e1-83f7-4d5a8bcfe5d1 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.141926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.143174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.143636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.144102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.145052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:07.145547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.151693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 841/1686] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:07.153198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.158613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.176596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 846/1687] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:07.182154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c5a02-fa19-4b30-a66e-3f2358393f81 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.182301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.190421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38adfa-cfcd-49b6-aab2-d80111981703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.191098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38adfa-cfcd-49b6-aab2-d80111981703 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.191382 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38adfa-cfcd-49b6-aab2-d80111981703 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.191656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38adfa-cfcd-49b6-aab2-d80111981703 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.192352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38adfa-cfcd-49b6-aab2-d80111981703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.194320 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38adfa-cfcd-49b6-aab2-d80111981703 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.198286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586cea7-2d1d-420e-b3a2-c7c9a1abdda6 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.207331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d1a8b-f023-4688-bdb9-c47ff912505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.208502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d1a8b-f023-4688-bdb9-c47ff912505f admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.208999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d1a8b-f023-4688-bdb9-c47ff912505f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.210163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d1a8b-f023-4688-bdb9-c47ff912505f admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.211112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d1a8b-f023-4688-bdb9-c47ff912505f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.213326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d1a8b-f023-4688-bdb9-c47ff912505f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.323118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 847/1688] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:07 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:07.328895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d1a8b-f023-4688-bdb9-c47ff912505f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.389332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 842/1689] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:07 2022] POST /identity/v3/projects => generated 371 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:07.389332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38adfa-cfcd-49b6-aab2-d80111981703 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.494350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d1a8b-f023-4688-bdb9-c47ff912505f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.550325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38adfa-cfcd-49b6-aab2-d80111981703 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.565503 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405328b-e3e9-446a-8fe6-8c9d2042f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.566326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405328b-e3e9-446a-8fe6-8c9d2042f448 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.566684 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405328b-e3e9-446a-8fe6-8c9d2042f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.567031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405328b-e3e9-446a-8fe6-8c9d2042f448 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.567965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405328b-e3e9-446a-8fe6-8c9d2042f448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.570360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405328b-e3e9-446a-8fe6-8c9d2042f448 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.589723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b738b3-4ff5-48e7-a832-567b02fe4908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.591052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b738b3-4ff5-48e7-a832-567b02fe4908 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.591666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b738b3-4ff5-48e7-a832-567b02fe4908 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.592110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b738b3-4ff5-48e7-a832-567b02fe4908 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.593111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b738b3-4ff5-48e7-a832-567b02fe4908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.595420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b738b3-4ff5-48e7-a832-567b02fe4908 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.693647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 843/1690] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:07 2022] POST /identity/v3/users => generated 286 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:07.702434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405328b-e3e9-446a-8fe6-8c9d2042f448 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.720329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405328b-e3e9-446a-8fe6-8c9d2042f448 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.732957 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 848/1691] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:07 2022] POST /identity/v3/users => generated 284 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:07.734009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b738b3-4ff5-48e7-a832-567b02fe4908 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.737528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5498c1-0164-4c3d-a4ec-67b2cf706841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.738680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5498c1-0164-4c3d-a4ec-67b2cf706841 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.739195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5498c1-0164-4c3d-a4ec-67b2cf706841 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.739690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5498c1-0164-4c3d-a4ec-67b2cf706841 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.740673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5498c1-0164-4c3d-a4ec-67b2cf706841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.743181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5498c1-0164-4c3d-a4ec-67b2cf706841 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.765301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 844/1692] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:07.769450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5498c1-0164-4c3d-a4ec-67b2cf706841 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.793635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b738b3-4ff5-48e7-a832-567b02fe4908 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.798336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5498c1-0164-4c3d-a4ec-67b2cf706841 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.811905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cddd0b-8055-425f-85d1-2957bab8650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.812671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddd0b-8055-425f-85d1-2957bab8650b admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.812971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddd0b-8055-425f-85d1-2957bab8650b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.813259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddd0b-8055-425f-85d1-2957bab8650b admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.814009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cddd0b-8055-425f-85d1-2957bab8650b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.815889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cddd0b-8055-425f-85d1-2957bab8650b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.816201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5791250-2ca7-4299-be38-a5100d63967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.817122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5791250-2ca7-4299-be38-a5100d63967c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.817611 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5791250-2ca7-4299-be38-a5100d63967c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.818164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5791250-2ca7-4299-be38-a5100d63967c admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.823068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5791250-2ca7-4299-be38-a5100d63967c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.823295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:07.825504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5791250-2ca7-4299-be38-a5100d63967c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.849224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 845/1693] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:07.850671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5791250-2ca7-4299-be38-a5100d63967c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.859982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 849/1694] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:07.862684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cddd0b-8055-425f-85d1-2957bab8650b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.865716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5791250-2ca7-4299-be38-a5100d63967c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.872780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35db63-07aa-425c-b29f-492ea87f72c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.873917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35db63-07aa-425c-b29f-492ea87f72c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.874432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35db63-07aa-425c-b29f-492ea87f72c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.875488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35db63-07aa-425c-b29f-492ea87f72c9 admin admin] PATH_INFO: `/v3/projects/9ee43951ab5a4998ae9090d8c1a18b5b/users/ebaf5b949e2e47509a5b8823cd82f73d/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.898421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cddd0b-8055-425f-85d1-2957bab8650b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.901242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35db63-07aa-425c-b29f-492ea87f72c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee43951ab5a4998ae9090d8c1a18b5b, user_id=ebaf5b949e2e47509a5b8823cd82f73d, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.905260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35db63-07aa-425c-b29f-492ea87f72c9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.910856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b32c3-3593-4788-b86d-009dde0601f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.912185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b32c3-3593-4788-b86d-009dde0601f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.912826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b32c3-3593-4788-b86d-009dde0601f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.913314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b32c3-3593-4788-b86d-009dde0601f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.917462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b32c3-3593-4788-b86d-009dde0601f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:07.921591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b32c3-3593-4788-b86d-009dde0601f4 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:07.935775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 850/1695] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:07.939518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b32c3-3593-4788-b86d-009dde0601f4 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:07.951543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b32c3-3593-4788-b86d-009dde0601f4 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:07.958458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689dd4f-38d0-4748-b3ee-78c5a0880a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:07.959685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689dd4f-38d0-4748-b3ee-78c5a0880a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:07.960228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689dd4f-38d0-4748-b3ee-78c5a0880a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:07.960883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689dd4f-38d0-4748-b3ee-78c5a0880a81 admin admin] PATH_INFO: `/v3/projects/86585fbcaab844f79d3e1b19c259390e/users/ccbcd42dcef14b9e8f57e96a94a1c026/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:07.981048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689dd4f-38d0-4748-b3ee-78c5a0880a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86585fbcaab844f79d3e1b19c259390e, user_id=ccbcd42dcef14b9e8f57e96a94a1c026, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:08.002360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 846/1696] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:07 2022] PUT /identity/v3/projects/9ee43951ab5a4998ae9090d8c1a18b5b/users/ebaf5b949e2e47509a5b8823cd82f73d/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:08.002466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689dd4f-38d0-4748-b3ee-78c5a0880a81 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:08.004899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825effa0-718f-43fe-a492-3188c3fb30fb None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:08.005979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825effa0-718f-43fe-a492-3188c3fb30fb None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:08.006736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825effa0-718f-43fe-a492-3188c3fb30fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:08.061521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-825effa0-718f-43fe-a492-3188c3fb30fb None None] MFA Rules not processed for user `ebaf5b949e2e47509a5b8823cd82f73d`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:08.064273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-825effa0-718f-43fe-a492-3188c3fb30fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:08.081713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 851/1697] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:07 2022] PUT /identity/v3/projects/86585fbcaab844f79d3e1b19c259390e/users/ccbcd42dcef14b9e8f57e96a94a1c026/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:08.093964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc680d-d430-4a9c-917d-8b4cac9ec859 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:08.094369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc680d-d430-4a9c-917d-8b4cac9ec859 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:08.094732 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc680d-d430-4a9c-917d-8b4cac9ec859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:08.147791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-8ecc680d-d430-4a9c-917d-8b4cac9ec859 None None] MFA Rules not processed for user `ccbcd42dcef14b9e8f57e96a94a1c026`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:08.149711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8ecc680d-d430-4a9c-917d-8b4cac9ec859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:08.164871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 847/1698] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:08.166525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825effa0-718f-43fe-a492-3188c3fb30fb None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:08.171443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:08.251113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825effa0-718f-43fe-a492-3188c3fb30fb None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:08.291831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 852/1699] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:08.326834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4fe69-2b91-4e33-a312-601f87ec6578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:08.327616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4fe69-2b91-4e33-a312-601f87ec6578 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:08.327922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4fe69-2b91-4e33-a312-601f87ec6578 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:08.328199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4fe69-2b91-4e33-a312-601f87ec6578 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:08.329006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4fe69-2b91-4e33-a312-601f87ec6578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:08.331681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4fe69-2b91-4e33-a312-601f87ec6578 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:08.391750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc680d-d430-4a9c-917d-8b4cac9ec859 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:08.393184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8ecc680d-d430-4a9c-917d-8b4cac9ec859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:08.419236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 848/1700] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:08 2022] POST /identity/v3/projects => generated 371 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:08.421395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4fe69-2b91-4e33-a312-601f87ec6578 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:08.527911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc680d-d430-4a9c-917d-8b4cac9ec859 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:08.577181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4fe69-2b91-4e33-a312-601f87ec6578 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:08.585867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fa632-52db-424b-8512-47750454c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:08.586853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fa632-52db-424b-8512-47750454c134 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:08.590786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fa632-52db-424b-8512-47750454c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:08.590786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fa632-52db-424b-8512-47750454c134 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:08.590786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fa632-52db-424b-8512-47750454c134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:08.591987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fa632-52db-424b-8512-47750454c134 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:08.626047 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d8dc6-0f11-4ec2-beeb-b49a472e7875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:08.627634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8dc6-0f11-4ec2-beeb-b49a472e7875 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:08.628128 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8dc6-0f11-4ec2-beeb-b49a472e7875 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:08.628614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8dc6-0f11-4ec2-beeb-b49a472e7875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:08.657682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:08.673180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 849/1701] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:08 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:52:08.677078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fa632-52db-424b-8512-47750454c134 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:08.705895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fa632-52db-424b-8512-47750454c134 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:08.721065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c810-b446-4170-8519-eba8f4d16120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:08.722468 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c810-b446-4170-8519-eba8f4d16120 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:08.723930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c810-b446-4170-8519-eba8f4d16120 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:08.724681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c810-b446-4170-8519-eba8f4d16120 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:08.727705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033c810-b446-4170-8519-eba8f4d16120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:08.732328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033c810-b446-4170-8519-eba8f4d16120 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:08.779027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d8dc6-0f11-4ec2-beeb-b49a472e7875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:08.780858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 850/1702] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:08.781376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d8dc6-0f11-4ec2-beeb-b49a472e7875 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:08.786451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c810-b446-4170-8519-eba8f4d16120 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:08.793014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 853/1703] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:52:08.809604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c810-b446-4170-8519-eba8f4d16120 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:08.821114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593a7b2-d608-4662-9bb3-ce3599d3272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:08.822217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a7b2-d608-4662-9bb3-ce3599d3272f admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:08.822582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a7b2-d608-4662-9bb3-ce3599d3272f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:08.822937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a7b2-d608-4662-9bb3-ce3599d3272f admin admin] PATH_INFO: `/v3/projects/26120ce6a69847839c116e1787975795/users/76b5da7f1e5145df928f11c310d9668d/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:08.840210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:08.847855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593a7b2-d608-4662-9bb3-ce3599d3272f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26120ce6a69847839c116e1787975795, user_id=76b5da7f1e5145df928f11c310d9668d, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:08.852553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593a7b2-d608-4662-9bb3-ce3599d3272f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:08.933143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 851/1704] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:08 2022] PUT /identity/v3/projects/26120ce6a69847839c116e1787975795/users/76b5da7f1e5145df928f11c310d9668d/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:08.938546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d8dc6-0f11-4ec2-beeb-b49a472e7875 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:08.960300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d8dc6-0f11-4ec2-beeb-b49a472e7875 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:09.060133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781baf-3b5c-48b4-b6f2-0e8dff5da837 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.060428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781baf-3b5c-48b4-b6f2-0e8dff5da837 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.060706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781baf-3b5c-48b4-b6f2-0e8dff5da837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.119294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10639653-e6d8-43ca-87f2-2e74b8345e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:09.119989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10639653-e6d8-43ca-87f2-2e74b8345e5c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.120279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10639653-e6d8-43ca-87f2-2e74b8345e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.120565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10639653-e6d8-43ca-87f2-2e74b8345e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.121490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10639653-e6d8-43ca-87f2-2e74b8345e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:09.126164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10639653-e6d8-43ca-87f2-2e74b8345e5c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:09.140680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-2e781baf-3b5c-48b4-b6f2-0e8dff5da837 None None] MFA Rules not processed for user `aaddfdaef98f40568252faf626550cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:09.143257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2e781baf-3b5c-48b4-b6f2-0e8dff5da837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:09.153314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 854/1705] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:09.159587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10639653-e6d8-43ca-87f2-2e74b8345e5c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:09.175171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10639653-e6d8-43ca-87f2-2e74b8345e5c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:09.180906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa4d50-d3d3-4e5f-b6cd-b96bb1548c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:09.181821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4d50-d3d3-4e5f-b6cd-b96bb1548c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.182136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4d50-d3d3-4e5f-b6cd-b96bb1548c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.182427 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4d50-d3d3-4e5f-b6cd-b96bb1548c61 admin admin] PATH_INFO: `/v3/projects/26120ce6a69847839c116e1787975795/users/76b5da7f1e5145df928f11c310d9668d/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.187893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa4d50-d3d3-4e5f-b6cd-b96bb1548c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26120ce6a69847839c116e1787975795, user_id=76b5da7f1e5145df928f11c310d9668d, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:09.189386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa4d50-d3d3-4e5f-b6cd-b96bb1548c61 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:09.230535 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 855/1706] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:09 2022] PUT /identity/v3/projects/26120ce6a69847839c116e1787975795/users/76b5da7f1e5145df928f11c310d9668d/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:09.232390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c80ac3-57b2-4209-82d9-22d02f4f101e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.232817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c80ac3-57b2-4209-82d9-22d02f4f101e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.233182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c80ac3-57b2-4209-82d9-22d02f4f101e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.273027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c5c80ac3-57b2-4209-82d9-22d02f4f101e None None] MFA Rules not processed for user `76b5da7f1e5145df928f11c310d9668d`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:09.274462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c5c80ac3-57b2-4209-82d9-22d02f4f101e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:09.288744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 852/1707] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:09.332963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8877c-c651-4915-90e0-7e8b6a9d64c0 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.333183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8877c-c651-4915-90e0-7e8b6a9d64c0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.333646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8877c-c651-4915-90e0-7e8b6a9d64c0 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.335545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 853/1708] 10.222.0.20 () {54 vars in 961 bytes} [Mon Jul 11 14:52:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:52:09.348691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec6f9b-19a9-4890-abf6-69ee07848039 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.349066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec6f9b-19a9-4890-abf6-69ee07848039 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.349419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec6f9b-19a9-4890-abf6-69ee07848039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.380607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-00ec6f9b-19a9-4890-abf6-69ee07848039 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:09.392356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-00ec6f9b-19a9-4890-abf6-69ee07848039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:09.490555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 856/1709] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:09.499607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c80ac3-57b2-4209-82d9-22d02f4f101e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:09.520618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c80ac3-57b2-4209-82d9-22d02f4f101e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:09.532638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b5da7f1e5145df928f11c310d9668d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26120ce6a69847839c116e1787975795', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:09.533557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.533849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.534153 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.536222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:09.537615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:09.541206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:09.565461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 854/1710] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jul 11 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:09.572849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec6f9b-19a9-4890-abf6-69ee07848039 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:09.574716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 857/1711] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:09.575911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:09.598403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec6f9b-19a9-4890-abf6-69ee07848039 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:09.608844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28bb11-96bb-4099-8a49-a87a81f86a92 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:09.611605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636be8f-6265-4ab9-86fd-2dddadcf8208 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b5da7f1e5145df928f11c310d9668d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26120ce6a69847839c116e1787975795', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:09.612302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636be8f-6265-4ab9-86fd-2dddadcf8208 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.613620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636be8f-6265-4ab9-86fd-2dddadcf8208 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.613926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636be8f-6265-4ab9-86fd-2dddadcf8208 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.615603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636be8f-6265-4ab9-86fd-2dddadcf8208 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:09.621659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636be8f-6265-4ab9-86fd-2dddadcf8208 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:09.623407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:09.623787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.624075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.626042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.648746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:09.711938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:09.713835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:09.714754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 855/1712] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:09 2022] POST /identity/v3/projects => generated 349 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:09.715706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636be8f-6265-4ab9-86fd-2dddadcf8208 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:09.725080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 858/1713] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:09.811811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:09.833953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636be8f-6265-4ab9-86fd-2dddadcf8208 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:09.839133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9cb1d-1276-4b38-98b9-0ef2e4bd2732 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b5da7f1e5145df928f11c310d9668d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26120ce6a69847839c116e1787975795', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:09.839728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cb1d-1276-4b38-98b9-0ef2e4bd2732 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.840154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cb1d-1276-4b38-98b9-0ef2e4bd2732 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.840447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cb1d-1276-4b38-98b9-0ef2e4bd2732 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.841235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9cb1d-1276-4b38-98b9-0ef2e4bd2732 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:09.841567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9cb1d-1276-4b38-98b9-0ef2e4bd2732 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:09.843473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9cb1d-1276-4b38-98b9-0ef2e4bd2732 tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:09.876632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 856/1714] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:09.891217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:09.903532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:09.922415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0a905-731f-49fa-b9da-8e49582e7bb4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:09.922728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0a905-731f-49fa-b9da-8e49582e7bb4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:09.922978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0a905-731f-49fa-b9da-8e49582e7bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:09.953642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-93c0a905-731f-49fa-b9da-8e49582e7bb4 None None] MFA Rules not processed for user `e53d0c7429474cfc84570a9d2e61605a`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:09.955309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-93c0a905-731f-49fa-b9da-8e49582e7bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:10.038681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2db14d-1949-4456-95bb-5a2527250694 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:10.068509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 857/1715] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:10.113554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618379-bd5e-4498-8bea-6c8a4ae99494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:10.115119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618379-bd5e-4498-8bea-6c8a4ae99494 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:10.115621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618379-bd5e-4498-8bea-6c8a4ae99494 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:10.116304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618379-bd5e-4498-8bea-6c8a4ae99494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:10.133870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618379-bd5e-4498-8bea-6c8a4ae99494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:10.135364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618379-bd5e-4498-8bea-6c8a4ae99494 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:10.146307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 859/1716] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:10.185981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70022-388a-4031-ba7c-fd6d4fb58e7f None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:10.186300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70022-388a-4031-ba7c-fd6d4fb58e7f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:10.186584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70022-388a-4031-ba7c-fd6d4fb58e7f None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:10.188580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 858/1717] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jul 11 14:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:10.194607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec9b3-fbac-49ad-8d4b-6deedd34eeb1 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:10.194974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec9b3-fbac-49ad-8d4b-6deedd34eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:10.195298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec9b3-fbac-49ad-8d4b-6deedd34eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:10.221067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-be6ec9b3-fbac-49ad-8d4b-6deedd34eeb1 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:10.223057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-be6ec9b3-fbac-49ad-8d4b-6deedd34eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:10.309932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 860/1718] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 14:52:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:10.329000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f70022-388a-4031-ba7c-fd6d4fb58e7f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:10.331589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f1f70022-388a-4031-ba7c-fd6d4fb58e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:10.504431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f70022-388a-4031-ba7c-fd6d4fb58e7f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:10.517137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e016f-87ec-47e4-9e2f-541cda0fdd4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42bb727957e40dca943c47785819223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:10.530796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e016f-87ec-47e4-9e2f-541cda0fdd4c service glance] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:10.530796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e016f-87ec-47e4-9e2f-541cda0fdd4c service glance] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:10.530796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e016f-87ec-47e4-9e2f-541cda0fdd4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:10.555132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e016f-87ec-47e4-9e2f-541cda0fdd4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:10.573249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e016f-87ec-47e4-9e2f-541cda0fdd4c service glance] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:10.606358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 859/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:11.514184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004501-e6b8-438d-bf48-cd32a42a6f4a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:11.514184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004501-e6b8-438d-bf48-cd32a42a6f4a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:11.514184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004501-e6b8-438d-bf48-cd32a42a6f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:11.542708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:11.607308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-50004501-e6b8-438d-bf48-cd32a42a6f4a None None] MFA Rules not processed for user `d079c09918a649d88b2afa2a2ed44a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:11.610684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-50004501-e6b8-438d-bf48-cd32a42a6f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:11.849453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 861/1720] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:11.859705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e016f-87ec-47e4-9e2f-541cda0fdd4c service glance] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:11.889744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e016f-87ec-47e4-9e2f-541cda0fdd4c service glance] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:11.912200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213089a9-ab32-458d-8a6a-60d2eeab65eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:11.913037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213089a9-ab32-458d-8a6a-60d2eeab65eb service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:11.913401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213089a9-ab32-458d-8a6a-60d2eeab65eb service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:11.914285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213089a9-ab32-458d-8a6a-60d2eeab65eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:11.940718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213089a9-ab32-458d-8a6a-60d2eeab65eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:11.943615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213089a9-ab32-458d-8a6a-60d2eeab65eb service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:11.969507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 860/1721] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:13.134867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc569-3cbd-41fa-838f-6a07e3dc0de0 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:13.137389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc569-3cbd-41fa-838f-6a07e3dc0de0 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:13.137389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc569-3cbd-41fa-838f-6a07e3dc0de0 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:13.137937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 862/1722] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jul 11 14:52:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:13.149391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76394c1f-89f0-4d3e-92fc-9fac1c1b380e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:13.160563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76394c1f-89f0-4d3e-92fc-9fac1c1b380e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:13.160563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76394c1f-89f0-4d3e-92fc-9fac1c1b380e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:13.249777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-76394c1f-89f0-4d3e-92fc-9fac1c1b380e None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:13.254027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-76394c1f-89f0-4d3e-92fc-9fac1c1b380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:13.279249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 861/1723] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:13.396468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc569-3cbd-41fa-838f-6a07e3dc0de0 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:13.422041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc569-3cbd-41fa-838f-6a07e3dc0de0 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:13.433524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a73f04-d1a5-4f0a-a2a8-f293df055965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:13.434479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a73f04-d1a5-4f0a-a2a8-f293df055965 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:13.434932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a73f04-d1a5-4f0a-a2a8-f293df055965 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:13.435360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a73f04-d1a5-4f0a-a2a8-f293df055965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:13.451558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a73f04-d1a5-4f0a-a2a8-f293df055965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:13.457956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a73f04-d1a5-4f0a-a2a8-f293df055965 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:13.475425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 863/1724] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:14.441464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e31a-a6ba-41e8-b1f3-5d9f63d0d27d None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:14.442929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e31a-a6ba-41e8-b1f3-5d9f63d0d27d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:14.444130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e31a-a6ba-41e8-b1f3-5d9f63d0d27d None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:14.450271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 862/1725] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 14:52:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:14.483136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7c65-d955-4bc6-aa5f-03b28b1a3ca6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:14.483618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7c65-d955-4bc6-aa5f-03b28b1a3ca6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:14.494450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7c65-d955-4bc6-aa5f-03b28b1a3ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:14.558938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-250f7c65-d955-4bc6-aa5f-03b28b1a3ca6 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:14.561179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-250f7c65-d955-4bc6-aa5f-03b28b1a3ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:14.701888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 864/1726] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:14.781247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9230e-77b0-4b7a-8825-fc804dc2ca3e None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:14.781470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9230e-77b0-4b7a-8825-fc804dc2ca3e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:14.782165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9230e-77b0-4b7a-8825-fc804dc2ca3e None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:14.783428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 863/1727] 10.222.0.20 () {54 vars in 960 bytes} [Mon Jul 11 14:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:14.789249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acccdde-ad25-4413-bdc7-0daad907ec76 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:14.789756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acccdde-ad25-4413-bdc7-0daad907ec76 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:14.790255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acccdde-ad25-4413-bdc7-0daad907ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:14.816003 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9acccdde-ad25-4413-bdc7-0daad907ec76 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:14.817360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9acccdde-ad25-4413-bdc7-0daad907ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:14.840345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9230e-77b0-4b7a-8825-fc804dc2ca3e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:14.844349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 865/1728] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Jul 11 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:14.861106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9230e-77b0-4b7a-8825-fc804dc2ca3e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:14.868317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcede71-c0f4-4041-82cd-a185829511d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:14.869440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcede71-c0f4-4041-82cd-a185829511d8 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:14.870050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcede71-c0f4-4041-82cd-a185829511d8 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:14.870810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcede71-c0f4-4041-82cd-a185829511d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:14.886861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcede71-c0f4-4041-82cd-a185829511d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:14.888855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcede71-c0f4-4041-82cd-a185829511d8 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:14.915534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 864/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:52:15.419465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352d16-ae6f-4bf4-80a8-ffad2ca4b54c None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:15.420149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352d16-ae6f-4bf4-80a8-ffad2ca4b54c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:15.420634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352d16-ae6f-4bf4-80a8-ffad2ca4b54c None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:15.422362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 866/1730] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jul 11 14:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:15.431467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5aacf-e8b2-453d-8732-d829eb766bf2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:15.432394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5aacf-e8b2-453d-8732-d829eb766bf2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:15.432905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5aacf-e8b2-453d-8732-d829eb766bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:15.481132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-e9d5aacf-e8b2-453d-8732-d829eb766bf2 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:15.482471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e9d5aacf-e8b2-453d-8732-d829eb766bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:15.499238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35352d16-ae6f-4bf4-80a8-ffad2ca4b54c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:15.502821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 865/1731] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:15.528524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35352d16-ae6f-4bf4-80a8-ffad2ca4b54c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:15.547901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:15.549251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:15.549651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:15.550030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:15.553906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:15.554391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5aacf-e8b2-453d-8732-d829eb766bf2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:15.568119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5aacf-e8b2-453d-8732-d829eb766bf2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:15.580127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cb75a-47da-4877-bbc0-17cdeeda1777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:15.581713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cb75a-47da-4877-bbc0-17cdeeda1777 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:15.582497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cb75a-47da-4877-bbc0-17cdeeda1777 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:15.584599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cb75a-47da-4877-bbc0-17cdeeda1777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:15.591750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:15.594994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:15.613577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cb75a-47da-4877-bbc0-17cdeeda1777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:15.615644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cb75a-47da-4877-bbc0-17cdeeda1777 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:15.630647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 867/1732] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:52:15.650139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 866/1733] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:52:19.656116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:19.657630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:19.843197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6451-4ba2-4380-bb2c-3d151f01d33a service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:19.854539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e26fe6a43b49dcb776c92894ed56f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b6af816df640d282a5b353fab11eec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:19.855668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:19.856179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:19.856701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:19.857684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:19.858243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:19.861464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:19.880739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:19.914813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 868/1734] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:19.915797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cb75a-47da-4877-bbc0-17cdeeda1777 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:19.926000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:19.935457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cb75a-47da-4877-bbc0-17cdeeda1777 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:19.950232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4474f-9d91-49d9-8235-bfc92931bc5a tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e26fe6a43b49dcb776c92894ed56f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b6af816df640d282a5b353fab11eec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:19.950486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4474f-9d91-49d9-8235-bfc92931bc5a tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:19.950827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4474f-9d91-49d9-8235-bfc92931bc5a tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:19.951122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4474f-9d91-49d9-8235-bfc92931bc5a tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:19.960947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4474f-9d91-49d9-8235-bfc92931bc5a tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:19.967277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4474f-9d91-49d9-8235-bfc92931bc5a tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:20.083724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 867/1735] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:19 2022] POST /identity/v3/projects => generated 347 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:20.083847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:20.099573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62738ade-b73d-45e0-bb48-7bd0f889f8c4 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:20.240177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e26fe6a43b49dcb776c92894ed56f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b6af816df640d282a5b353fab11eec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:20.240868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:20.241179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:20.241605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:20.243015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:20.243255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:20.246463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:20.284224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 869/1736] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:52:20.325850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036483be-321e-4003-ac86-2b7f3e357064 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:20.326487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036483be-321e-4003-ac86-2b7f3e357064 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:20.326996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036483be-321e-4003-ac86-2b7f3e357064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:20.465222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-036483be-321e-4003-ac86-2b7f3e357064 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:20.465222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-036483be-321e-4003-ac86-2b7f3e357064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:20.577857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 868/1737] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:20.941977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:21.032408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036483be-321e-4003-ac86-2b7f3e357064 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:21.041877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-036483be-321e-4003-ac86-2b7f3e357064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:21.096454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0bb01-92de-4b8f-bd3e-7a52f373c7d2 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:21.119239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b5da7f1e5145df928f11c310d9668d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26120ce6a69847839c116e1787975795', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:21.120144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:21.120433 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:21.120707 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] PATH_INFO: `/v3/projects/b57f77d1bea24eba8f209b178e9aa68f` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:21.127244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b57f77d1bea24eba8f209b178e9aa68f)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:21.129504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:21.230580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036483be-321e-4003-ac86-2b7f3e357064 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:21.246017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176d990-9555-4adf-a385-2b9c67c7dfbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:21.246017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176d990-9555-4adf-a385-2b9c67c7dfbb service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:21.246017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176d990-9555-4adf-a385-2b9c67c7dfbb service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:21.246017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176d990-9555-4adf-a385-2b9c67c7dfbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:21.264067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176d990-9555-4adf-a385-2b9c67c7dfbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:21.267433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176d990-9555-4adf-a385-2b9c67c7dfbb service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:21.290986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 869/1738] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:52:21.390503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57f77d1bea24eba8f209b178e9aa68f', 'request_id': 'req-2fb13837-92f6-4912-ae09-18fa4d5deffa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.531505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57f77d1bea24eba8f209b178e9aa68f', 'request_id': 'req-2fb13837-92f6-4912-ae09-18fa4d5deffa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.546550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57f77d1bea24eba8f209b178e9aa68f', 'request_id': 'req-2fb13837-92f6-4912-ae09-18fa4d5deffa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.591312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] The token cache is being invalidate because project b57f77d1bea24eba8f209b178e9aa68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:21.591312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.595992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2fb13837-92f6-4912-ae09-18fa4d5deffa tempest-QuotasNegativeTest-523981932 tempest-QuotasNegativeTest-523981932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.604665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 870/1739] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:20 2022] DELETE /identity/v3/projects/b57f77d1bea24eba8f209b178e9aa68f => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:21.606024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176d990-9555-4adf-a385-2b9c67c7dfbb service swift] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:21.682334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:21.821841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176d990-9555-4adf-a385-2b9c67c7dfbb service swift] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:22.025851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:22.027485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.028286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.029003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] PATH_INFO: `/v3/users/ebaf5b949e2e47509a5b8823cd82f73d` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.031039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebaf5b949e2e47509a5b8823cd82f73d)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:22.035170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:22.333019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebaf5b949e2e47509a5b8823cd82f73d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:22.423109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebaf5b949e2e47509a5b8823cd82f73d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:22.473923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebaf5b949e2e47509a5b8823cd82f73d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:22.485396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebaf5b949e2e47509a5b8823cd82f73d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:22.500643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebaf5b949e2e47509a5b8823cd82f73d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:22.521939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 870/1740] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:21 2022] DELETE /identity/v3/users/ebaf5b949e2e47509a5b8823cd82f73d => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:22.529221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff365a3-952b-4595-bec9-f600343e5840 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.529810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff365a3-952b-4595-bec9-f600343e5840 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.530374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff365a3-952b-4595-bec9-f600343e5840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.557041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:22.561386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:22.595891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0ff365a3-952b-4595-bec9-f600343e5840 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:22.599399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0ff365a3-952b-4595-bec9-f600343e5840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:22.654265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:22.712754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:22.749268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d389f-9f6f-43e5-9db7-e7545d97e7cf admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:22.761928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e26fe6a43b49dcb776c92894ed56f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b6af816df640d282a5b353fab11eec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:22.766914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.767309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.767607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] PATH_INFO: `/v3/projects/70add8c246854e7792c7ee77e5c3188f` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.771837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Authorizing `identity:delete_project(project_id=70add8c246854e7792c7ee77e5c3188f)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:22.779715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:22.798645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 871/1741] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:22.978613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70add8c246854e7792c7ee77e5c3188f', 'request_id': 'req-6c63347f-3c4e-4aef-a08f-f828af854505'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:23.017335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff365a3-952b-4595-bec9-f600343e5840 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:23.019252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0ff365a3-952b-4595-bec9-f600343e5840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:23.143870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70add8c246854e7792c7ee77e5c3188f', 'request_id': 'req-6c63347f-3c4e-4aef-a08f-f828af854505'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:23.153177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70add8c246854e7792c7ee77e5c3188f', 'request_id': 'req-6c63347f-3c4e-4aef-a08f-f828af854505'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:23.157440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff365a3-952b-4595-bec9-f600343e5840 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:23.196927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] The token cache is being invalidate because project 70add8c246854e7792c7ee77e5c3188f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:23.196927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:23.197867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6c63347f-3c4e-4aef-a08f-f828af854505 tempest-RoutersIpV6AdminTest-363051124 tempest-RoutersIpV6AdminTest-363051124-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:23.203450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 871/1742] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:22 2022] DELETE /identity/v3/projects/70add8c246854e7792c7ee77e5c3188f => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:23.205183 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977157ef-f4d8-4738-97f3-131ab6464072 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:23.205479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977157ef-f4d8-4738-97f3-131ab6464072 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:23.205763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977157ef-f4d8-4738-97f3-131ab6464072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:23.255265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-977157ef-f4d8-4738-97f3-131ab6464072 None None] MFA Rules not processed for user `d079c09918a649d88b2afa2a2ed44a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:23.256874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-977157ef-f4d8-4738-97f3-131ab6464072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:23.330246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40028cb8-0811-4277-9ec6-008feaba5483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:23.330939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028cb8-0811-4277-9ec6-008feaba5483 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:23.331265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028cb8-0811-4277-9ec6-008feaba5483 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:23.331686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028cb8-0811-4277-9ec6-008feaba5483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:23.338464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-40028cb8-0811-4277-9ec6-008feaba5483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:23.484644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 872/1743] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:23.485674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977157ef-f4d8-4738-97f3-131ab6464072 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:23.488043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-977157ef-f4d8-4738-97f3-131ab6464072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:23.565663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977157ef-f4d8-4738-97f3-131ab6464072 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:23.577035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7dc62-d39a-454b-b256-db714e4da98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:23.584848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7dc62-d39a-454b-b256-db714e4da98b service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:23.585355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7dc62-d39a-454b-b256-db714e4da98b service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:23.587059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7dc62-d39a-454b-b256-db714e4da98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:23.595434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-62c7dc62-d39a-454b-b256-db714e4da98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:23.622876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40028cb8-0811-4277-9ec6-008feaba5483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:23.627074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40028cb8-0811-4277-9ec6-008feaba5483 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:23.665299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 872/1744] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:23.780674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7dc62-d39a-454b-b256-db714e4da98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:23.790457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7dc62-d39a-454b-b256-db714e4da98b service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:23.821507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 873/1745] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:23.913855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117895aa-e24d-4a60-a2f1-b37020ce379e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:23.914386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117895aa-e24d-4a60-a2f1-b37020ce379e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:23.914829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117895aa-e24d-4a60-a2f1-b37020ce379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:23.949244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-117895aa-e24d-4a60-a2f1-b37020ce379e None None] MFA Rules not processed for user `aaddfdaef98f40568252faf626550cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:23.952946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-117895aa-e24d-4a60-a2f1-b37020ce379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:23.982773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:24.048253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 873/1746] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:24.767250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bb851-eed1-44fd-9602-96bd73deffc6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:24.767983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bb851-eed1-44fd-9602-96bd73deffc6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:24.767983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bb851-eed1-44fd-9602-96bd73deffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:24.792634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3b7bb851-eed1-44fd-9602-96bd73deffc6 None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:24.795033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3b7bb851-eed1-44fd-9602-96bd73deffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:24.812300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 874/1747] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:24.835357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117895aa-e24d-4a60-a2f1-b37020ce379e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:24.837871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-117895aa-e24d-4a60-a2f1-b37020ce379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:24.858616 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117895aa-e24d-4a60-a2f1-b37020ce379e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:24.864161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeede0cc-6ff7-4138-ad31-46580ce1ef99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:24.865251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeede0cc-6ff7-4138-ad31-46580ce1ef99 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:24.865803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeede0cc-6ff7-4138-ad31-46580ce1ef99 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:24.866388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeede0cc-6ff7-4138-ad31-46580ce1ef99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:24.880404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeede0cc-6ff7-4138-ad31-46580ce1ef99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:24.883611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeede0cc-6ff7-4138-ad31-46580ce1ef99 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:24.909182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 874/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:24.976086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bb851-eed1-44fd-9602-96bd73deffc6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:24.977779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3b7bb851-eed1-44fd-9602-96bd73deffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:24.996630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bb851-eed1-44fd-9602-96bd73deffc6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:25.004570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:25.006083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:25.006707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:25.008413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] PATH_INFO: `/v3/projects/9ee43951ab5a4998ae9090d8c1a18b5b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:25.011278 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee43951ab5a4998ae9090d8c1a18b5b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:25.014637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:25.034821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:25.161727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee43951ab5a4998ae9090d8c1a18b5b', 'request_id': 'req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:25.229442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee43951ab5a4998ae9090d8c1a18b5b', 'request_id': 'req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:25.241058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee43951ab5a4998ae9090d8c1a18b5b', 'request_id': 'req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:25.328309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] The token cache is being invalidate because project 9ee43951ab5a4998ae9090d8c1a18b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:25.333424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:25.339802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:25.350350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 875/1749] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:24 2022] DELETE /identity/v3/projects/9ee43951ab5a4998ae9090d8c1a18b5b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:25.357634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeede0cc-6ff7-4138-ad31-46580ce1ef99 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:25.390096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeede0cc-6ff7-4138-ad31-46580ce1ef99 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:25.573660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:25.576943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:25.577459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:25.578455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] PATH_INFO: `/v3/users/76b5da7f1e5145df928f11c310d9668d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:25.583650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b5da7f1e5145df928f11c310d9668d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:25.591903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:26.242675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b5da7f1e5145df928f11c310d9668d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:26.359260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b5da7f1e5145df928f11c310d9668d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:26.395887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b5da7f1e5145df928f11c310d9668d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:26.426628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b5da7f1e5145df928f11c310d9668d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:26.427704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-679d86ff-2ea6-4423-adc2-d621cfb6bd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b5da7f1e5145df928f11c310d9668d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:26.446751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 875/1750] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:25 2022] DELETE /identity/v3/users/76b5da7f1e5145df928f11c310d9668d => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:27.156252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:27.158137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:27.233594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188d36-7b8c-4dc0-a51b-2af3e3b8ede7 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:27.402648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:27.406616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:27.406616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:27.406616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] PATH_INFO: `/v3/users/66a79df6a87a40dda8e45864d0b4bdba` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:27.408430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c76f4-5aa4-4ec8-8797-a900b5a1ead1 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:27.409196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c76f4-5aa4-4ec8-8797-a900b5a1ead1 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:27.409815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c76f4-5aa4-4ec8-8797-a900b5a1ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:27.426244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a79df6a87a40dda8e45864d0b4bdba)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:27.434288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:27.473993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-041c76f4-5aa4-4ec8-8797-a900b5a1ead1 None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:27.475884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-041c76f4-5aa4-4ec8-8797-a900b5a1ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:27.533320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:27.566286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 876/1751] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Jul 11 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:27.652478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c76f4-5aa4-4ec8-8797-a900b5a1ead1 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:27.652478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-041c76f4-5aa4-4ec8-8797-a900b5a1ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:27.659057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c76f4-5aa4-4ec8-8797-a900b5a1ead1 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:27.671303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20dcab-8872-4d01-8fcb-6c57ecf9741e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:27.672567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20dcab-8872-4d01-8fcb-6c57ecf9741e service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:27.677458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20dcab-8872-4d01-8fcb-6c57ecf9741e service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:27.677458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20dcab-8872-4d01-8fcb-6c57ecf9741e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:27.693036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20dcab-8872-4d01-8fcb-6c57ecf9741e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:27.699421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20dcab-8872-4d01-8fcb-6c57ecf9741e service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:27.720841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 877/1752] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:28.010562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a79df6a87a40dda8e45864d0b4bdba'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:28.255692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a79df6a87a40dda8e45864d0b4bdba'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:28.305058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a79df6a87a40dda8e45864d0b4bdba'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:28.310816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a79df6a87a40dda8e45864d0b4bdba'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:28.332747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a79df6a87a40dda8e45864d0b4bdba'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:28.348812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b91d9-0b04-4f43-b9aa-361100c597f6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.352068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b91d9-0b04-4f43-b9aa-361100c597f6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.352492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b91d9-0b04-4f43-b9aa-361100c597f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.361954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 876/1753] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:27 2022] DELETE /identity/v3/users/66a79df6a87a40dda8e45864d0b4bdba => generated 0 bytes in 1188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:28.412213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e75b91d9-0b04-4f43-b9aa-361100c597f6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:28.415127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e75b91d9-0b04-4f43-b9aa-361100c597f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:28.559413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 878/1754] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:28.567049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:28.568878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:28.649603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:28.745114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357d64a-58df-4329-bbd7-6aee6be5974e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:28.749841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:28.878589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.878589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.878589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.878589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:28.878589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:28.878589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 877/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:29.363539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b91d9-0b04-4f43-b9aa-361100c597f6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:29.363539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e75b91d9-0b04-4f43-b9aa-361100c597f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:29.398958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b91d9-0b04-4f43-b9aa-361100c597f6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:29.404828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:29.406141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:29.406459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:29.406720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] PATH_INFO: `/v3/projects/ca1da3e2bcee48f1886a96c31c45f667` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:29.411338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1da3e2bcee48f1886a96c31c45f667)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:29.416208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:29.443466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:29.445429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:29.474860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b93529-4b5c-4e3e-86cb-588c88076333 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:29.483551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:29.484432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:29.484732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:29.485018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] PATH_INFO: `/v3/projects/26120ce6a69847839c116e1787975795` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:29.488678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26120ce6a69847839c116e1787975795)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:29.493506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:29.654478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1da3e2bcee48f1886a96c31c45f667', 'request_id': 'req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:29.738244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1da3e2bcee48f1886a96c31c45f667', 'request_id': 'req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:29.747074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1da3e2bcee48f1886a96c31c45f667', 'request_id': 'req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:29.775633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26120ce6a69847839c116e1787975795', 'request_id': 'req-04ada2a5-f5f3-45d7-8943-9b4187bbda16'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:29.788750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] The token cache is being invalidate because project ca1da3e2bcee48f1886a96c31c45f667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:29.789172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:29.790225 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:29.793025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 879/1756] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:29 2022] DELETE /identity/v3/projects/ca1da3e2bcee48f1886a96c31c45f667 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:29.798315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:29.800242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:30.018772 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:30.026907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7fd4-38d4-4960-98e6-69084bf3bc8e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:30.068597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26120ce6a69847839c116e1787975795', 'request_id': 'req-04ada2a5-f5f3-45d7-8943-9b4187bbda16'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:30.079006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26120ce6a69847839c116e1787975795', 'request_id': 'req-04ada2a5-f5f3-45d7-8943-9b4187bbda16'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:30.095898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] The token cache is being invalidate because project 26120ce6a69847839c116e1787975795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:30.096351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:30.097552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-04ada2a5-f5f3-45d7-8943-9b4187bbda16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:30.101850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 878/1757] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:29 2022] DELETE /identity/v3/projects/26120ce6a69847839c116e1787975795 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:30.111368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b468-bd0a-4fc5-a2b0-d5e462263a32 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:30.113207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b468-bd0a-4fc5-a2b0-d5e462263a32 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:30.113929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b468-bd0a-4fc5-a2b0-d5e462263a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:30.141383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-56f9b468-bd0a-4fc5-a2b0-d5e462263a32 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:30.144699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-56f9b468-bd0a-4fc5-a2b0-d5e462263a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:30.217647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:30.219023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:30.219552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:30.220059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] PATH_INFO: `/v3/users/858ae85f11a043888b3bd797db75fa67` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:30.222259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] RBAC: Authorizing `identity:delete_user(user_id=858ae85f11a043888b3bd797db75fa67)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:30.227377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:30.321858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 879/1758] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:30.330275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb4d0-2f5a-41b1-9fd1-719b6be9eacd None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:30.330612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb4d0-2f5a-41b1-9fd1-719b6be9eacd None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:30.330843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb4d0-2f5a-41b1-9fd1-719b6be9eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:30.384455 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b5ebb4d0-2f5a-41b1-9fd1-719b6be9eacd None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:30.385472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b5ebb4d0-2f5a-41b1-9fd1-719b6be9eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:30.405686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 880/1759] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:30.410529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb4d0-2f5a-41b1-9fd1-719b6be9eacd None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:30.426787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb4d0-2f5a-41b1-9fd1-719b6be9eacd None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:30.437163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:30.438529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:30.439141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:30.439702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:30.440956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:30.441686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:30.444322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:30.490274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 881/1760] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:30.490274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:30.493134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd08937-b475-4e7f-bff3-7059b4c31f42 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:30.499532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244473f-9824-4afa-8e22-5199d7bcd3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:30.501402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244473f-9824-4afa-8e22-5199d7bcd3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:30.501816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244473f-9824-4afa-8e22-5199d7bcd3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:30.502265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244473f-9824-4afa-8e22-5199d7bcd3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:30.503179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244473f-9824-4afa-8e22-5199d7bcd3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:30.505812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244473f-9824-4afa-8e22-5199d7bcd3e1 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:30.788158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858ae85f11a043888b3bd797db75fa67'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:30.816387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 882/1761] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:30 2022] POST /identity/v3/projects => generated 373 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:30.825731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244473f-9824-4afa-8e22-5199d7bcd3e1 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:30.901082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858ae85f11a043888b3bd797db75fa67'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:30.980088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244473f-9824-4afa-8e22-5199d7bcd3e1 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:30.980354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858ae85f11a043888b3bd797db75fa67'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:31.003008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc3db1-6e27-4c28-a8bd-1140cd7a7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:31.003692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3db1-6e27-4c28-a8bd-1140cd7a7012 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.003992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3db1-6e27-4c28-a8bd-1140cd7a7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.004318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3db1-6e27-4c28-a8bd-1140cd7a7012 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.005159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc3db1-6e27-4c28-a8bd-1140cd7a7012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:31.010226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc3db1-6e27-4c28-a8bd-1140cd7a7012 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:31.028630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858ae85f11a043888b3bd797db75fa67'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:31.031189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858ae85f11a043888b3bd797db75fa67'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:31.060799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 880/1762] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:29 2022] DELETE /identity/v3/users/858ae85f11a043888b3bd797db75fa67 => generated 0 bytes in 1263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:31.133749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 883/1763] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:30 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:52:31.139761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:31.141528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:31.264002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d32ed7-4715-44b3-a9b2-3e6e28bd659b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:31.268525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858183dc-6c28-42a9-95b4-e3540450d080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:31.269472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858183dc-6c28-42a9-95b4-e3540450d080 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.269946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858183dc-6c28-42a9-95b4-e3540450d080 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.270430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858183dc-6c28-42a9-95b4-e3540450d080 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.271562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858183dc-6c28-42a9-95b4-e3540450d080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:31.273497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858183dc-6c28-42a9-95b4-e3540450d080 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:31.297238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 881/1764] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:31.301530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc3db1-6e27-4c28-a8bd-1140cd7a7012 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:31.314598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc3db1-6e27-4c28-a8bd-1140cd7a7012 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:31.319925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:31.320891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.320891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.321173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.321947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:31.323627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:31.344217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 884/1765] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:31.348669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858183dc-6c28-42a9-95b4-e3540450d080 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:31.358418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858183dc-6c28-42a9-95b4-e3540450d080 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:31.364280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ccf9e-8154-4250-887c-2e7807c5bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:31.365190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ccf9e-8154-4250-887c-2e7807c5bf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.365530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ccf9e-8154-4250-887c-2e7807c5bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.365877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ccf9e-8154-4250-887c-2e7807c5bf4b admin admin] PATH_INFO: `/v3/projects/72f7168567a4453f8bf639b237323b22/users/bc5d68bdba3643d18c561440b584777a/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.398879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ccf9e-8154-4250-887c-2e7807c5bf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f7168567a4453f8bf639b237323b22, user_id=bc5d68bdba3643d18c561440b584777a, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:31.403286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ccf9e-8154-4250-887c-2e7807c5bf4b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:31.407685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:31.410482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:31.426399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655d13-8e45-4a58-ae30-3f2320befa82 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:31.447410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:31.450929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.451516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.452834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] PATH_INFO: `/v3/projects/b8e22eb1658147beb78518d892198553` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.454506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e22eb1658147beb78518d892198553)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:31.468729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:31.528940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 882/1766] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:31 2022] PUT /identity/v3/projects/72f7168567a4453f8bf639b237323b22/users/bc5d68bdba3643d18c561440b584777a/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:31.540850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60c511-ec62-4929-aebc-17f1c3df59b6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.541153 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60c511-ec62-4929-aebc-17f1c3df59b6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.541499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60c511-ec62-4929-aebc-17f1c3df59b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.591578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-fc60c511-ec62-4929-aebc-17f1c3df59b6 None None] MFA Rules not processed for user `bc5d68bdba3643d18c561440b584777a`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:31.598018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fc60c511-ec62-4929-aebc-17f1c3df59b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:31.741688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 883/1767] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:31.767203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60c511-ec62-4929-aebc-17f1c3df59b6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:31.769035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fc60c511-ec62-4929-aebc-17f1c3df59b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:31.899310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e22eb1658147beb78518d892198553', 'request_id': 'req-17468d3e-d558-43c6-8ac7-42690a23b331'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:31.988319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e22eb1658147beb78518d892198553', 'request_id': 'req-17468d3e-d558-43c6-8ac7-42690a23b331'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.000630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e22eb1658147beb78518d892198553', 'request_id': 'req-17468d3e-d558-43c6-8ac7-42690a23b331'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.046260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] The token cache is being invalidate because project b8e22eb1658147beb78518d892198553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:32.047191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.050067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-17468d3e-d558-43c6-8ac7-42690a23b331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.053736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60c511-ec62-4929-aebc-17f1c3df59b6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:32.055760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 885/1768] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:31 2022] DELETE /identity/v3/projects/b8e22eb1658147beb78518d892198553 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:32.060358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cdfce-1fbb-445b-9a39-c1cbbb5dad0f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.063020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cdfce-1fbb-445b-9a39-c1cbbb5dad0f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.063483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cdfce-1fbb-445b-9a39-c1cbbb5dad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.153331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ab7cdfce-1fbb-445b-9a39-c1cbbb5dad0f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:32.154810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ab7cdfce-1fbb-445b-9a39-c1cbbb5dad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:32.233518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:32.234428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.235018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.235452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.240450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:32.318200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 886/1769] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:32.321786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e30b-a1e0-47d8-bc3b-544a990bbeb6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.323847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e30b-a1e0-47d8-bc3b-544a990bbeb6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.324003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e30b-a1e0-47d8-bc3b-544a990bbeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.358561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-04f3e30b-a1e0-47d8-bc3b-544a990bbeb6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:32.359926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-04f3e30b-a1e0-47d8-bc3b-544a990bbeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:32.370690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:32.374435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:32.398925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 884/1770] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:52:32.402939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 887/1771] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:32.407696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:32.468359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0e56f-752a-48cc-b7df-cd8257ca4d65 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:32.468359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:32.468359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.468359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.468672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.468672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:32.468672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:32.487708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:32.515367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 885/1772] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:32.516735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e30b-a1e0-47d8-bc3b-544a990bbeb6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:32.529676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e30b-a1e0-47d8-bc3b-544a990bbeb6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:32.536819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeabfbd-f6d4-40ba-92a0-d16575587784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:32.539125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeabfbd-f6d4-40ba-92a0-d16575587784 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.539966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeabfbd-f6d4-40ba-92a0-d16575587784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.540479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeabfbd-f6d4-40ba-92a0-d16575587784 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.541732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeabfbd-f6d4-40ba-92a0-d16575587784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:32.544868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeabfbd-f6d4-40ba-92a0-d16575587784 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:32.606863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:32.654566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 888/1773] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:32 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:32.660923 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:32.691618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de449200-f40e-4bc7-ac1d-f0a63f0782bf admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:32.812497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95f22-038e-4cb3-9ea5-e4c75c9b3c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:32.813354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95f22-038e-4cb3-9ea5-e4c75c9b3c10 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.813641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95f22-038e-4cb3-9ea5-e4c75c9b3c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.814024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95f22-038e-4cb3-9ea5-e4c75c9b3c10 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.814754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c95f22-038e-4cb3-9ea5-e4c75c9b3c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:32.816675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c95f22-038e-4cb3-9ea5-e4c75c9b3c10 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:32.953239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 886/1774] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:32 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:32.958173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeabfbd-f6d4-40ba-92a0-d16575587784 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:32.978900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeabfbd-f6d4-40ba-92a0-d16575587784 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:32.985402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca3c75-6394-41cf-93c1-bdc3b4ed0071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:32.986137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca3c75-6394-41cf-93c1-bdc3b4ed0071 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.986496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca3c75-6394-41cf-93c1-bdc3b4ed0071 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.986773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca3c75-6394-41cf-93c1-bdc3b4ed0071 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.987512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca3c75-6394-41cf-93c1-bdc3b4ed0071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:32.989670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca3c75-6394-41cf-93c1-bdc3b4ed0071 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:33.022440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95f22-038e-4cb3-9ea5-e4c75c9b3c10 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:33.034281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 889/1775] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:33.037454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95f22-038e-4cb3-9ea5-e4c75c9b3c10 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:33.067374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6a08a-86c1-4e9d-a527-3cc131e30a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:33.068106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a08a-86c1-4e9d-a527-3cc131e30a1c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.068598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a08a-86c1-4e9d-a527-3cc131e30a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.068598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a08a-86c1-4e9d-a527-3cc131e30a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.069589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6a08a-86c1-4e9d-a527-3cc131e30a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:33.073948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6a08a-86c1-4e9d-a527-3cc131e30a1c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:33.106719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca3c75-6394-41cf-93c1-bdc3b4ed0071 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:33.119254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 887/1776] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:33.124122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca3c75-6394-41cf-93c1-bdc3b4ed0071 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:33.129307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf50cc8-e05a-463a-85d3-e0adaed343c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:33.138981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50cc8-e05a-463a-85d3-e0adaed343c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.139410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50cc8-e05a-463a-85d3-e0adaed343c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.139705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50cc8-e05a-463a-85d3-e0adaed343c6 admin admin] PATH_INFO: `/v3/projects/92919fd533694a228aa64d11728d8386/users/1e28c319708e4a52b5d9b240ba55940a/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.175852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf50cc8-e05a-463a-85d3-e0adaed343c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92919fd533694a228aa64d11728d8386, user_id=1e28c319708e4a52b5d9b240ba55940a, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:33.181061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf50cc8-e05a-463a-85d3-e0adaed343c6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:33.258259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:33.298721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 890/1777] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:33 2022] PUT /identity/v3/projects/92919fd533694a228aa64d11728d8386/users/1e28c319708e4a52b5d9b240ba55940a/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:33.299929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361448a8-6740-4cf9-9c63-2370dd2aa7bc None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.300389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361448a8-6740-4cf9-9c63-2370dd2aa7bc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.300809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361448a8-6740-4cf9-9c63-2370dd2aa7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.406139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-361448a8-6740-4cf9-9c63-2370dd2aa7bc None None] MFA Rules not processed for user `1e28c319708e4a52b5d9b240ba55940a`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:33.407383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-361448a8-6740-4cf9-9c63-2370dd2aa7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:33.548610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ab15-c266-4d98-8dfc-4ec4eefd0823 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.548610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ab15-c266-4d98-8dfc-4ec4eefd0823 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.548610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ab15-c266-4d98-8dfc-4ec4eefd0823 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.549801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 891/1778] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 14:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:33.569361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54276f3-17c7-44b4-b005-851246b88a92 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.570153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54276f3-17c7-44b4-b005-851246b88a92 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.570472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54276f3-17c7-44b4-b005-851246b88a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.612146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b54276f3-17c7-44b4-b005-851246b88a92 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:33.614278 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b54276f3-17c7-44b4-b005-851246b88a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:33.635063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 888/1779] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:33.652029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361448a8-6740-4cf9-9c63-2370dd2aa7bc None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:33.820994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 892/1780] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:33.922433 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361448a8-6740-4cf9-9c63-2370dd2aa7bc None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:33.933048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54276f3-17c7-44b4-b005-851246b88a92 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:33.937006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b54276f3-17c7-44b4-b005-851246b88a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:33.939665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4100a-b2ac-40ff-8303-dbec1f01a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:33.940350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4100a-b2ac-40ff-8303-dbec1f01a021 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.940787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4100a-b2ac-40ff-8303-dbec1f01a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.941065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4100a-b2ac-40ff-8303-dbec1f01a021 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.941775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4100a-b2ac-40ff-8303-dbec1f01a021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:33.945488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4100a-b2ac-40ff-8303-dbec1f01a021 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:33.988444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54276f3-17c7-44b4-b005-851246b88a92 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:34.014939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cfd6d-42c0-4b25-8e7a-a5d4a417a69c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:34.016613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cfd6d-42c0-4b25-8e7a-a5d4a417a69c service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:34.017195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cfd6d-42c0-4b25-8e7a-a5d4a417a69c service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:34.017718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cfd6d-42c0-4b25-8e7a-a5d4a417a69c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:34.066990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cfd6d-42c0-4b25-8e7a-a5d4a417a69c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:34.073163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cfd6d-42c0-4b25-8e7a-a5d4a417a69c service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:34.091724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 889/1781] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:33 2022] POST /identity/v3/projects => generated 381 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:34.092943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4100a-b2ac-40ff-8303-dbec1f01a021 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:34.094418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 893/1782] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:34.241215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4100a-b2ac-40ff-8303-dbec1f01a021 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:34.262185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643da7b-89c9-4e57-9d66-0a56899f718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:34.262185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643da7b-89c9-4e57-9d66-0a56899f718a admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:34.262185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643da7b-89c9-4e57-9d66-0a56899f718a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:34.262185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643da7b-89c9-4e57-9d66-0a56899f718a admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:34.264511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643da7b-89c9-4e57-9d66-0a56899f718a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:34.276393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643da7b-89c9-4e57-9d66-0a56899f718a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:34.393787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cfd6d-42c0-4b25-8e7a-a5d4a417a69c service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:34.394149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 890/1783] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:34 2022] POST /identity/v3/users => generated 291 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:52:34.422426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cfd6d-42c0-4b25-8e7a-a5d4a417a69c service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:34.435717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d9c29-c659-4184-9436-63d0c3aaf6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:34.437085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9c29-c659-4184-9436-63d0c3aaf6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:34.438609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9c29-c659-4184-9436-63d0c3aaf6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:34.438609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9c29-c659-4184-9436-63d0c3aaf6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:34.442509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d9c29-c659-4184-9436-63d0c3aaf6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:34.445818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d9c29-c659-4184-9436-63d0c3aaf6d2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:34.467608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643da7b-89c9-4e57-9d66-0a56899f718a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:34.481381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 894/1784] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:52:34.484769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643da7b-89c9-4e57-9d66-0a56899f718a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:34.493403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4e008-341e-4fd1-9e77-3fcc7d9072a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:34.494390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4e008-341e-4fd1-9e77-3fcc7d9072a3 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:34.494854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4e008-341e-4fd1-9e77-3fcc7d9072a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:34.495294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4e008-341e-4fd1-9e77-3fcc7d9072a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:34.496188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4e008-341e-4fd1-9e77-3fcc7d9072a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:34.498582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4e008-341e-4fd1-9e77-3fcc7d9072a3 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:34.525358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 891/1785] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:34.527441 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d9c29-c659-4184-9436-63d0c3aaf6d2 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:34.546742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d9c29-c659-4184-9436-63d0c3aaf6d2 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:34.565175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309269-e4dd-4481-956e-eaae7d96071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:34.567192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309269-e4dd-4481-956e-eaae7d96071c admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:34.568102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309269-e4dd-4481-956e-eaae7d96071c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:34.569205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309269-e4dd-4481-956e-eaae7d96071c admin admin] PATH_INFO: `/v3/projects/df3c8c5e75f14b34ab02dfb691340433/users/9bd3cb8a41eb42cd80e28fff3044e564/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:34.610648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309269-e4dd-4481-956e-eaae7d96071c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3c8c5e75f14b34ab02dfb691340433, user_id=9bd3cb8a41eb42cd80e28fff3044e564, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:34.613771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309269-e4dd-4481-956e-eaae7d96071c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:34.731189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 895/1786] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:34 2022] PUT /identity/v3/projects/df3c8c5e75f14b34ab02dfb691340433/users/9bd3cb8a41eb42cd80e28fff3044e564/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:34.755596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6895a4-e636-4c40-8213-61af7e8ff768 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:34.756095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6895a4-e636-4c40-8213-61af7e8ff768 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:34.756600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6895a4-e636-4c40-8213-61af7e8ff768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:34.843818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9f6895a4-e636-4c40-8213-61af7e8ff768 None None] MFA Rules not processed for user `9bd3cb8a41eb42cd80e28fff3044e564`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:34.845799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:34.847298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9f6895a4-e636-4c40-8213-61af7e8ff768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:34.953851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309269-e4dd-4481-956e-eaae7d96071c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:34.954762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 892/1787] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:34.999855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:35.027706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309269-e4dd-4481-956e-eaae7d96071c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:35.040760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33ba56-82a9-4d4d-8d63-27249e3bfc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:35.041812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33ba56-82a9-4d4d-8d63-27249e3bfc22 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.042299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33ba56-82a9-4d4d-8d63-27249e3bfc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.042743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33ba56-82a9-4d4d-8d63-27249e3bfc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:35.044084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33ba56-82a9-4d4d-8d63-27249e3bfc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:35.046238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33ba56-82a9-4d4d-8d63-27249e3bfc22 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:35.177635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 896/1788] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:34 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:35.181977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6895a4-e636-4c40-8213-61af7e8ff768 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:35.194271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6895a4-e636-4c40-8213-61af7e8ff768 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:35.269938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94120-ca6f-4726-8d89-5cf5dae1ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:35.270186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94120-ca6f-4726-8d89-5cf5dae1ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.270555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94120-ca6f-4726-8d89-5cf5dae1ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.270931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94120-ca6f-4726-8d89-5cf5dae1ca66 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:35.271798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d94120-ca6f-4726-8d89-5cf5dae1ca66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:35.275459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d94120-ca6f-4726-8d89-5cf5dae1ca66 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:35.370022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 893/1789] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:35 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:35.371254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33ba56-82a9-4d4d-8d63-27249e3bfc22 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:35.390873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33ba56-82a9-4d4d-8d63-27249e3bfc22 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:35.398887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe6ec-e4d6-49c7-a218-4cc24072ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:35.399883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe6ec-e4d6-49c7-a218-4cc24072ce25 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.400332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe6ec-e4d6-49c7-a218-4cc24072ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.401173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe6ec-e4d6-49c7-a218-4cc24072ce25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:35.402195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efe6ec-e4d6-49c7-a218-4cc24072ce25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:35.405846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efe6ec-e4d6-49c7-a218-4cc24072ce25 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:35.429848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 897/1790] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:52:35.431122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94120-ca6f-4726-8d89-5cf5dae1ca66 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:35.449811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94120-ca6f-4726-8d89-5cf5dae1ca66 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:35.458007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3480c-8153-47e3-9198-1881d6a496b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:35.459232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3480c-8153-47e3-9198-1881d6a496b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.459797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3480c-8153-47e3-9198-1881d6a496b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.460143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3480c-8153-47e3-9198-1881d6a496b8 admin admin] PATH_INFO: `/v3/projects/51060259bdd14ad8b06407eabeba4812/users/e188f9414b22462ca17caf12ed599d69/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:35.487204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3480c-8153-47e3-9198-1881d6a496b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51060259bdd14ad8b06407eabeba4812, user_id=e188f9414b22462ca17caf12ed599d69, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:35.491042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3480c-8153-47e3-9198-1881d6a496b8 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:35.593819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 894/1791] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:35 2022] PUT /identity/v3/projects/51060259bdd14ad8b06407eabeba4812/users/e188f9414b22462ca17caf12ed599d69/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:52:35.599580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe6ec-e4d6-49c7-a218-4cc24072ce25 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:35.650174 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe6ec-e4d6-49c7-a218-4cc24072ce25 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:35.800473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:35.820936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb3d6d-377e-4b8c-b828-4601b9fbb068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:35.821638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb3d6d-377e-4b8c-b828-4601b9fbb068 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.821925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb3d6d-377e-4b8c-b828-4601b9fbb068 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.822233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb3d6d-377e-4b8c-b828-4601b9fbb068 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:35.822986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb3d6d-377e-4b8c-b828-4601b9fbb068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:35.827080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb3d6d-377e-4b8c-b828-4601b9fbb068 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:35.855442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 898/1792] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:35.856932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3480c-8153-47e3-9198-1881d6a496b8 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:35.871829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3480c-8153-47e3-9198-1881d6a496b8 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:35.878223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:35.881078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.881371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.881658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] PATH_INFO: `/v3/projects/51060259bdd14ad8b06407eabeba4812/users/e188f9414b22462ca17caf12ed599d69/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:35.885013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51060259bdd14ad8b06407eabeba4812, user_id=e188f9414b22462ca17caf12ed599d69, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:35.889805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:35.903433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:35.951950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 895/1793] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:35 2022] PUT /identity/v3/projects/51060259bdd14ad8b06407eabeba4812/users/e188f9414b22462ca17caf12ed599d69/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:35.953604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce474e-c8ea-4de7-b0ef-c41747bcf3ea None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.953901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce474e-c8ea-4de7-b0ef-c41747bcf3ea None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.954219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce474e-c8ea-4de7-b0ef-c41747bcf3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.004271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b5ce474e-c8ea-4de7-b0ef-c41747bcf3ea None None] MFA Rules not processed for user `e188f9414b22462ca17caf12ed599d69`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:36.005508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b5ce474e-c8ea-4de7-b0ef-c41747bcf3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:36.124661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 899/1794] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:36.235221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:36.240431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:36.340012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1e346-056c-44e6-a7b1-2bb8b8182a3c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:36.345830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0ad3a-ca9c-47f3-bff0-e26331a5ea46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:36.346983 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ad3a-ca9c-47f3-bff0-e26331a5ea46 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.347280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ad3a-ca9c-47f3-bff0-e26331a5ea46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.348108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ad3a-ca9c-47f3-bff0-e26331a5ea46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.432988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0ad3a-ca9c-47f3-bff0-e26331a5ea46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:36.434491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0ad3a-ca9c-47f3-bff0-e26331a5ea46 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:36.450180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 896/1795] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:36.818506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cae9e-1405-4c0a-9527-4b273391d25c None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.819493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cae9e-1405-4c0a-9527-4b273391d25c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.820550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cae9e-1405-4c0a-9527-4b273391d25c None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.822446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 900/1796] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 14:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:36.846912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b3c4-e6fd-4c8d-9328-890122c7ee57 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.847482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b3c4-e6fd-4c8d-9328-890122c7ee57 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.847727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b3c4-e6fd-4c8d-9328-890122c7ee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.879557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-cf20b3c4-e6fd-4c8d-9328-890122c7ee57 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:36.886602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cf20b3c4-e6fd-4c8d-9328-890122c7ee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:37.002142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 897/1797] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:37.026975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cae9e-1405-4c0a-9527-4b273391d25c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:37.026975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-041cae9e-1405-4c0a-9527-4b273391d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:37.045675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:37.052617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cae9e-1405-4c0a-9527-4b273391d25c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:37.062627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241726d7-ac12-482e-8dca-4776634ff400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:37.063877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241726d7-ac12-482e-8dca-4776634ff400 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:37.064380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241726d7-ac12-482e-8dca-4776634ff400 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:37.064838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241726d7-ac12-482e-8dca-4776634ff400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:37.084103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241726d7-ac12-482e-8dca-4776634ff400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:37.086423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241726d7-ac12-482e-8dca-4776634ff400 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:37.112429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 901/1798] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:38.177347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:43.312499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f84a4-53d5-4668-a460-c4b0cd20e0c6 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:43.313571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f84a4-53d5-4668-a460-c4b0cd20e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:43.314018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f84a4-53d5-4668-a460-c4b0cd20e0c6 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:43.315970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 898/1799] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 14:52:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:43.350138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0f89-f42e-471b-a355-3dab56ec8df9 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:43.352811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0f89-f42e-471b-a355-3dab56ec8df9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:43.352811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0f89-f42e-471b-a355-3dab56ec8df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:43.392315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ea8a0f89-f42e-471b-a355-3dab56ec8df9 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:43.397713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ea8a0f89-f42e-471b-a355-3dab56ec8df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:43.419837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 902/1800] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:43.652368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f84a4-53d5-4668-a460-c4b0cd20e0c6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:43.680291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f84a4-53d5-4668-a460-c4b0cd20e0c6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:43.688558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd9dec-8aad-48bd-a3c0-bc0b4f4600f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:43.690659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd9dec-8aad-48bd-a3c0-bc0b4f4600f2 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:43.691152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd9dec-8aad-48bd-a3c0-bc0b4f4600f2 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:43.691596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd9dec-8aad-48bd-a3c0-bc0b4f4600f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:43.714646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd9dec-8aad-48bd-a3c0-bc0b4f4600f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:43.719576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd9dec-8aad-48bd-a3c0-bc0b4f4600f2 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:43.747000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 899/1801] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:53.385333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:53.729087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=15 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:06.947185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a0f89-f42e-471b-a355-3dab56ec8df9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:06.950119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ea8a0f89-f42e-471b-a355-3dab56ec8df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:06.973503 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a0f89-f42e-471b-a355-3dab56ec8df9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:06.987338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930285-c5a9-4853-8a7e-b94099844fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:06.990006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930285-c5a9-4853-8a7e-b94099844fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:06.990526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930285-c5a9-4853-8a7e-b94099844fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:06.991015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930285-c5a9-4853-8a7e-b94099844fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:07.027507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97930285-c5a9-4853-8a7e-b94099844fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:07.029429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97930285-c5a9-4853-8a7e-b94099844fd0 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:07.050632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 903/1802] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:17.043537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:18.859099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd9dec-8aad-48bd-a3c0-bc0b4f4600f2 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:18.872258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd9dec-8aad-48bd-a3c0-bc0b4f4600f2 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:18.878372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb00cd-bfa3-4d5e-83f7-3a5ccf46bce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:18.880323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb00cd-bfa3-4d5e-83f7-3a5ccf46bce8 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:18.881018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb00cd-bfa3-4d5e-83f7-3a5ccf46bce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:18.882412 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb00cd-bfa3-4d5e-83f7-3a5ccf46bce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:18.966806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb00cd-bfa3-4d5e-83f7-3a5ccf46bce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:18.968548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb00cd-bfa3-4d5e-83f7-3a5ccf46bce8 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:18.982453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 900/1803] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:28.975973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=28 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:42.535938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930285-c5a9-4853-8a7e-b94099844fd0 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:42.652749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930285-c5a9-4853-8a7e-b94099844fd0 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:42.659088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:42.661943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:42.661943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:42.661943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] PATH_INFO: `/v3/users/1e28c319708e4a52b5d9b240ba55940a` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:42.661943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e28c319708e4a52b5d9b240ba55940a)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:42.664466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:42.900056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e28c319708e4a52b5d9b240ba55940a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:42.976748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e28c319708e4a52b5d9b240ba55940a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:43.015549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e28c319708e4a52b5d9b240ba55940a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:43.016710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e28c319708e4a52b5d9b240ba55940a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:43.038171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e28c319708e4a52b5d9b240ba55940a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:43.053462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 904/1804] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:42 2022] DELETE /identity/v3/users/1e28c319708e4a52b5d9b240ba55940a => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:43.058639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd150-ade9-45a1-b391-e4a89b529311 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:43.059670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd150-ade9-45a1-b391-e4a89b529311 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:43.060111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd150-ade9-45a1-b391-e4a89b529311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:43.087047 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4b5bd150-ade9-45a1-b391-e4a89b529311 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:43.088560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4b5bd150-ade9-45a1-b391-e4a89b529311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:43.195270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 901/1805] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:43.220289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:43.221946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:43.403288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef20e9-fd17-4cf7-ab8a-c6fdd2c48eab admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:43.411965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:43.413184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:43.419567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:43.419567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:43.444343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:43.444343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:43.459449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 905/1806] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:44.517511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bd150-ade9-45a1-b391-e4a89b529311 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:44.520394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4b5bd150-ade9-45a1-b391-e4a89b529311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:44.545261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bd150-ade9-45a1-b391-e4a89b529311 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:44.552467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:44.552467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:44.552467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:44.552467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] PATH_INFO: `/v3/users/ccbcd42dcef14b9e8f57e96a94a1c026` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:44.559464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccbcd42dcef14b9e8f57e96a94a1c026)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:44.562829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:44.832296 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccbcd42dcef14b9e8f57e96a94a1c026'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:44.892540 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:44.894073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:44.920869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15447-1a67-48e7-a792-c785cf6b0a25 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:44.927435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:44.930022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:44.930587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:44.931186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] PATH_INFO: `/v3/projects/92919fd533694a228aa64d11728d8386` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:44.932994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=92919fd533694a228aa64d11728d8386)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:44.938286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccbcd42dcef14b9e8f57e96a94a1c026'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:44.945880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:44.965562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccbcd42dcef14b9e8f57e96a94a1c026'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:44.980681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccbcd42dcef14b9e8f57e96a94a1c026'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:44.981737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-74728002-7436-4a09-b12a-d4907ff6ef87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccbcd42dcef14b9e8f57e96a94a1c026'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:44.995538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 902/1807] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:44 2022] DELETE /identity/v3/users/ccbcd42dcef14b9e8f57e96a94a1c026 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:45.000523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:45.002982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066718b-61c5-4f3b-b917-75cc897681b6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:45.002982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066718b-61c5-4f3b-b917-75cc897681b6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:45.002982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066718b-61c5-4f3b-b917-75cc897681b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:45.048500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f066718b-61c5-4f3b-b917-75cc897681b6 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:45.049775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f066718b-61c5-4f3b-b917-75cc897681b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:45.136600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 903/1808] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:53:45.151337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92919fd533694a228aa64d11728d8386', 'request_id': 'req-10bcbb92-f57e-4a15-8677-27a521c42bea'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.154769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066718b-61c5-4f3b-b917-75cc897681b6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:45.157121 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f066718b-61c5-4f3b-b917-75cc897681b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:45.176851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:45.227958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066718b-61c5-4f3b-b917-75cc897681b6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:45.283928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92919fd533694a228aa64d11728d8386', 'request_id': 'req-10bcbb92-f57e-4a15-8677-27a521c42bea'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.292348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92919fd533694a228aa64d11728d8386', 'request_id': 'req-10bcbb92-f57e-4a15-8677-27a521c42bea'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.313136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] The token cache is being invalidate because project 92919fd533694a228aa64d11728d8386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:45.315396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.316167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:45.317207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.318751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:45.320478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:45.320844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:45.324258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 906/1809] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:44 2022] DELETE /identity/v3/projects/92919fd533694a228aa64d11728d8386 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:45.326792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:45.329659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:45.329864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:45.474128 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:45.477190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:45.479549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcbb92-f57e-4a15-8677-27a521c42bea admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:45.496962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 904/1810] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:45.497066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:45.497066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:45.497066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:45.497066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] PATH_INFO: `/v3/users/9bd3cb8a41eb42cd80e28fff3044e564` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:45.498585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd3cb8a41eb42cd80e28fff3044e564)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:45.500939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:45.689795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd3cb8a41eb42cd80e28fff3044e564'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.769949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd3cb8a41eb42cd80e28fff3044e564'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.787049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd3cb8a41eb42cd80e28fff3044e564'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.788695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd3cb8a41eb42cd80e28fff3044e564'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.795801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd3cb8a41eb42cd80e28fff3044e564'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:45.803161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 907/1811] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:45 2022] DELETE /identity/v3/users/9bd3cb8a41eb42cd80e28fff3044e564 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:46.908195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:46.910770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:46.932060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525979c-8fd7-43b6-a1cd-700f5e40f193 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:47.040742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:47.042041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:47.042892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:47.043530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] PATH_INFO: `/v3/projects/86585fbcaab844f79d3e1b19c259390e` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:47.045343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=86585fbcaab844f79d3e1b19c259390e)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:47.052217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:47.068316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:47.071009 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:47.095915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdb756-19bc-4447-b3fc-4a37ee93cd58 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:47.101074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:47.113882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:47.116279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:47.116690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:47.116973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] PATH_INFO: `/v3/projects/df3c8c5e75f14b34ab02dfb691340433` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:47.118270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3c8c5e75f14b34ab02dfb691340433)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:47.120873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:47.152089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:47.213504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86585fbcaab844f79d3e1b19c259390e', 'request_id': 'req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.260545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3c8c5e75f14b34ab02dfb691340433', 'request_id': 'req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.286509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86585fbcaab844f79d3e1b19c259390e', 'request_id': 'req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.300889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86585fbcaab844f79d3e1b19c259390e', 'request_id': 'req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.318736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] The token cache is being invalidate because project 86585fbcaab844f79d3e1b19c259390e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:47.319426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.322292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d7ac6626-a9a6-4120-9e9e-974fdc9fdc6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.330295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 905/1812] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:46 2022] DELETE /identity/v3/projects/86585fbcaab844f79d3e1b19c259390e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:47.331840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d859a-5346-48e2-8c5f-b6becc3db200 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:47.332142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d859a-5346-48e2-8c5f-b6becc3db200 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:47.332482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d859a-5346-48e2-8c5f-b6becc3db200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:47.353454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-012d859a-5346-48e2-8c5f-b6becc3db200 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:47.354787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-012d859a-5346-48e2-8c5f-b6becc3db200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:47.370006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3c8c5e75f14b34ab02dfb691340433', 'request_id': 'req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.377057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3c8c5e75f14b34ab02dfb691340433', 'request_id': 'req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.409271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] The token cache is being invalidate because project df3c8c5e75f14b34ab02dfb691340433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:47.409579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.417259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.422503 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 908/1813] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:47 2022] DELETE /identity/v3/projects/df3c8c5e75f14b34ab02dfb691340433 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:47.426766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:47.431052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:47.509357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 906/1814] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:47.517313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74f149-30ac-42e8-88fd-79a619a13e04 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:47.517647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74f149-30ac-42e8-88fd-79a619a13e04 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:47.518062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74f149-30ac-42e8-88fd-79a619a13e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:47.590882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-8f74f149-30ac-42e8-88fd-79a619a13e04 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:47.598700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8f74f149-30ac-42e8-88fd-79a619a13e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:47.606166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d95a38-cc5b-49ee-9cce-d91a46c60e3e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:47.628052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:47.629066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:47.629358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:47.629635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] PATH_INFO: `/v3/users/e188f9414b22462ca17caf12ed599d69` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:47.631801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 907/1815] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:53:47.635031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e188f9414b22462ca17caf12ed599d69)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:47.635226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74f149-30ac-42e8-88fd-79a619a13e04 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:47.639702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:47.665061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74f149-30ac-42e8-88fd-79a619a13e04 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:47.679973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:47.681075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:47.681990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:47.681990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:47.682901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:53:47.684087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:47.688486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:47.725411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 908/1816] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:53:47.730296 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:47.761340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8d39-d2ea-4903-b45b-4809fc2ae785 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:47.778349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbbd90-e307-4b57-9787-7f4e097e3e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:47.779417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbbd90-e307-4b57-9787-7f4e097e3e4a admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:47.779878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbbd90-e307-4b57-9787-7f4e097e3e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:47.780357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbbd90-e307-4b57-9787-7f4e097e3e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:47.781919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbbd90-e307-4b57-9787-7f4e097e3e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:47.784066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbbd90-e307-4b57-9787-7f4e097e3e4a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:47.892654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e188f9414b22462ca17caf12ed599d69'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.910560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 909/1817] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:47 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:53:47.913278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbbd90-e307-4b57-9787-7f4e097e3e4a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:47.954292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e188f9414b22462ca17caf12ed599d69'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.978069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e188f9414b22462ca17caf12ed599d69'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:47.979911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e188f9414b22462ca17caf12ed599d69'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:48.000467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e188f9414b22462ca17caf12ed599d69'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:48.022577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 909/1818] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:47 2022] DELETE /identity/v3/users/e188f9414b22462ca17caf12ed599d69 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:53:48.112879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbbd90-e307-4b57-9787-7f4e097e3e4a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:48.156606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:48.255685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255767a-b3be-4457-bc9b-4cb38bd3b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:48.257215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255767a-b3be-4457-bc9b-4cb38bd3b681 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:48.257581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255767a-b3be-4457-bc9b-4cb38bd3b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:48.259195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255767a-b3be-4457-bc9b-4cb38bd3b681 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:48.260021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255767a-b3be-4457-bc9b-4cb38bd3b681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:48.263266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255767a-b3be-4457-bc9b-4cb38bd3b681 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:48.366474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 910/1819] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:47 2022] POST /identity/v3/users => generated 290 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:48.370995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:48.371767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:48.397451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fca382-85b0-4ddd-bf09-7722680168ce admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:48.408805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67337f-7926-489d-8b45-b9ebcc201253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:48.409552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67337f-7926-489d-8b45-b9ebcc201253 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:48.409839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67337f-7926-489d-8b45-b9ebcc201253 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:48.410131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67337f-7926-489d-8b45-b9ebcc201253 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:48.410881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67337f-7926-489d-8b45-b9ebcc201253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:48.412545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67337f-7926-489d-8b45-b9ebcc201253 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:48.446202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 910/1820] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:48.451201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255767a-b3be-4457-bc9b-4cb38bd3b681 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:48.473366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255767a-b3be-4457-bc9b-4cb38bd3b681 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:48.487694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7afde-7dd5-4ca4-81c2-33160b41d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:48.489574 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7afde-7dd5-4ca4-81c2-33160b41d57a admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:48.490300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7afde-7dd5-4ca4-81c2-33160b41d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:48.490783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7afde-7dd5-4ca4-81c2-33160b41d57a admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:48.492196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7afde-7dd5-4ca4-81c2-33160b41d57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:48.495942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7afde-7dd5-4ca4-81c2-33160b41d57a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:48.536527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 911/1821] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:48.541041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67337f-7926-489d-8b45-b9ebcc201253 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:48.588521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67337f-7926-489d-8b45-b9ebcc201253 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:48.608419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:48.611245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:48.611758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:48.612326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] PATH_INFO: `/v3/projects/a1798dbd162241c0ac58506e584e5e6d/users/1be32873139d497ea5640c5f12ecc8a7/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:48.664869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:48.671494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1798dbd162241c0ac58506e584e5e6d, user_id=1be32873139d497ea5640c5f12ecc8a7, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:48.674349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:48.767482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 911/1822] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:48 2022] PUT /identity/v3/projects/a1798dbd162241c0ac58506e584e5e6d/users/1be32873139d497ea5640c5f12ecc8a7/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:48.779600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776bce1-b9f3-4284-a323-bf9b6132ec35 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:48.785778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776bce1-b9f3-4284-a323-bf9b6132ec35 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:48.786799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776bce1-b9f3-4284-a323-bf9b6132ec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:48.843570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5776bce1-b9f3-4284-a323-bf9b6132ec35 None None] MFA Rules not processed for user `1be32873139d497ea5640c5f12ecc8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:48.845190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5776bce1-b9f3-4284-a323-bf9b6132ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:48.947316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 912/1823] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:49.001715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:49.005044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:49.080246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e3444-4cae-4766-864e-e8a122c8b9f9 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:49.086158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:49.087046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:49.087481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:49.087910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:49.102497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:49.105091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:49.122852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 912/1824] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:49.365156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776bce1-b9f3-4284-a323-bf9b6132ec35 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:49.369326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5776bce1-b9f3-4284-a323-bf9b6132ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:49.550886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776bce1-b9f3-4284-a323-bf9b6132ec35 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:49.561625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:49.561625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:49.561953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:49.562536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] PATH_INFO: `/v3/users/e53d0c7429474cfc84570a9d2e61605a` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:49.564599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53d0c7429474cfc84570a9d2e61605a)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:49.575325 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:49.682144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:49.805970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53d0c7429474cfc84570a9d2e61605a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:49.914306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53d0c7429474cfc84570a9d2e61605a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:49.938905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53d0c7429474cfc84570a9d2e61605a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:49.954673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53d0c7429474cfc84570a9d2e61605a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:49.960116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c5368ac1-eab5-4df8-87b8-69b75caf0c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53d0c7429474cfc84570a9d2e61605a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:49.977709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 913/1825] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:49 2022] DELETE /identity/v3/users/e53d0c7429474cfc84570a9d2e61605a => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:50.207902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:50.210794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:50.298439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b6c8-4acb-4e42-bc02-0ad323dce1d5 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:50.532112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:50.533004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:50.533713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:50.533713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] PATH_INFO: `/v3/projects/51060259bdd14ad8b06407eabeba4812` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:50.535146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=51060259bdd14ad8b06407eabeba4812)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:50.537870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:50.747805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51060259bdd14ad8b06407eabeba4812', 'request_id': 'req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:50.844179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51060259bdd14ad8b06407eabeba4812', 'request_id': 'req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:50.857244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51060259bdd14ad8b06407eabeba4812', 'request_id': 'req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:50.874541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] The token cache is being invalidate because project 51060259bdd14ad8b06407eabeba4812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:50.874541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:50.875683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-32e51e5c-f8b6-4d3c-9600-61ccbc4306fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:50.890873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 913/1826] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:50 2022] DELETE /identity/v3/projects/51060259bdd14ad8b06407eabeba4812 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:50.895505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74281dd2-c02d-40ce-9d84-b7c7c7ba02b3 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:50.895802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74281dd2-c02d-40ce-9d84-b7c7c7ba02b3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:50.896085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74281dd2-c02d-40ce-9d84-b7c7c7ba02b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:50.931527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-74281dd2-c02d-40ce-9d84-b7c7c7ba02b3 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:50.935256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-74281dd2-c02d-40ce-9d84-b7c7c7ba02b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:51.086764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 914/1827] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:51.094231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32d6f-e73b-460f-afcf-08e6da824941 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.094585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32d6f-e73b-460f-afcf-08e6da824941 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.094874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32d6f-e73b-460f-afcf-08e6da824941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.120985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-29f32d6f-e73b-460f-afcf-08e6da824941 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:51.123027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-29f32d6f-e73b-460f-afcf-08e6da824941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:51.135950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 914/1828] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:51.139329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74281dd2-c02d-40ce-9d84-b7c7c7ba02b3 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.152145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f32d6f-e73b-460f-afcf-08e6da824941 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.154399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-29f32d6f-e73b-460f-afcf-08e6da824941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:51.156140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74281dd2-c02d-40ce-9d84-b7c7c7ba02b3 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:51.165794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:51.167196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.168639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.169176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.171829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:53:51.172631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:51.175026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:51.184146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f32d6f-e73b-460f-afcf-08e6da824941 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:51.193463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 915/1829] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:53:51.199101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:51.200210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.200748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.202052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.203873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] PATH_INFO: `/v3/projects/ff7fb57ab7154b83a448074b1e465dea` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.207775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7fb57ab7154b83a448074b1e465dea)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:51.218436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:51.230321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad474a-0667-4fe6-98dc-a1efd70b9b9c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:51.235555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:51.240172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0ad4e-49dd-4120-9b00-cab8b6d9d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:51.240881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ad4e-49dd-4120-9b00-cab8b6d9d700 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.241168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ad4e-49dd-4120-9b00-cab8b6d9d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.241446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ad4e-49dd-4120-9b00-cab8b6d9d700 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.242336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0ad4e-49dd-4120-9b00-cab8b6d9d700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:51.245995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0ad4e-49dd-4120-9b00-cab8b6d9d700 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:51.362831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7fb57ab7154b83a448074b1e465dea', 'request_id': 'req-7afff354-4dc6-404a-860c-712eb1de2fb6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:51.376536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 916/1830] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:51 2022] POST /identity/v3/projects => generated 397 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:51.380681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0ad4e-49dd-4120-9b00-cab8b6d9d700 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.478964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7fb57ab7154b83a448074b1e465dea', 'request_id': 'req-7afff354-4dc6-404a-860c-712eb1de2fb6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:51.515239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7fb57ab7154b83a448074b1e465dea', 'request_id': 'req-7afff354-4dc6-404a-860c-712eb1de2fb6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:51.530209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0ad4e-49dd-4120-9b00-cab8b6d9d700 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:51.547094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:51.547806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.548096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.548378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.549095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:51.551062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:51.582955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] The token cache is being invalidate because project ff7fb57ab7154b83a448074b1e465dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:51.583628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:51.587402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7afff354-4dc6-404a-860c-712eb1de2fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:51.596315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 915/1831] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:51 2022] DELETE /identity/v3/projects/ff7fb57ab7154b83a448074b1e465dea => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:51.601340 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58643684-98a7-4b12-b358-450c80937013 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.601924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58643684-98a7-4b12-b358-450c80937013 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.602439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58643684-98a7-4b12-b358-450c80937013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.681493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-58643684-98a7-4b12-b358-450c80937013 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:51.683630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-58643684-98a7-4b12-b358-450c80937013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:51.684687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:51.694893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 917/1832] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:51 2022] POST /identity/v3/users => generated 299 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:51.695793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.702664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:51.734434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 916/1833] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:51.745441 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea794795-91c6-46b5-bff8-7a9cf565123c None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.745976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea794795-91c6-46b5-bff8-7a9cf565123c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.746462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea794795-91c6-46b5-bff8-7a9cf565123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.754229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a14df3-7e42-4048-81ce-f8745daef21f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:51.772080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e6002-4349-4d8b-857a-98281744e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:51.773318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6002-4349-4d8b-857a-98281744e142 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.775152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6002-4349-4d8b-857a-98281744e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.776030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6002-4349-4d8b-857a-98281744e142 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.777736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e6002-4349-4d8b-857a-98281744e142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:51.781188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e6002-4349-4d8b-857a-98281744e142 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:51.807893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 918/1834] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:51.808865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e6002-4349-4d8b-857a-98281744e142 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.834110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e6002-4349-4d8b-857a-98281744e142 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:51.838633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ea794795-91c6-46b5-bff8-7a9cf565123c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:51.841079 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ea794795-91c6-46b5-bff8-7a9cf565123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:51.847530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3201e6-1356-4d1e-9e4e-0f28cc24010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:51.848502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3201e6-1356-4d1e-9e4e-0f28cc24010a admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.848804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3201e6-1356-4d1e-9e4e-0f28cc24010a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.849092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3201e6-1356-4d1e-9e4e-0f28cc24010a admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.849868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3201e6-1356-4d1e-9e4e-0f28cc24010a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:51.851562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3201e6-1356-4d1e-9e4e-0f28cc24010a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:51.852536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 917/1835] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 11 14:53:51.859515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea794795-91c6-46b5-bff8-7a9cf565123c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.877024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 919/1836] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:51.880563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3201e6-1356-4d1e-9e4e-0f28cc24010a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.893120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea794795-91c6-46b5-bff8-7a9cf565123c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:51.901878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3201e6-1356-4d1e-9e4e-0f28cc24010a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:51.909561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:51.912688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.913161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.913779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.917120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:53:51.917637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:51.918260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfe7d6-7b69-465b-9530-575ab7305a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:51.919191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe7d6-7b69-465b-9530-575ab7305a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:51.919486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe7d6-7b69-465b-9530-575ab7305a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:51.919774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe7d6-7b69-465b-9530-575ab7305a3a admin admin] PATH_INFO: `/v3/projects/429fff1afce148ada441f9b993837865/users/d9bfef842672407c992c59ca51329f53/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:51.924918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:51.952253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfe7d6-7b69-465b-9530-575ab7305a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=429fff1afce148ada441f9b993837865, user_id=d9bfef842672407c992c59ca51329f53, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:51.954995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfe7d6-7b69-465b-9530-575ab7305a3a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:51.960396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 918/1837] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:53:51.963951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:51.986022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98f3a-b822-4203-9412-39503099e52f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:52.018642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220baf6a-27f3-40b4-becd-ac6351a92836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:52.020980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220baf6a-27f3-40b4-becd-ac6351a92836 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.022627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220baf6a-27f3-40b4-becd-ac6351a92836 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.023087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220baf6a-27f3-40b4-becd-ac6351a92836 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:52.027767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220baf6a-27f3-40b4-becd-ac6351a92836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:52.029958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220baf6a-27f3-40b4-becd-ac6351a92836 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:52.062385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 920/1838] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:51 2022] PUT /identity/v3/projects/429fff1afce148ada441f9b993837865/users/d9bfef842672407c992c59ca51329f53/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:52.070877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95961281-b1c9-4d85-b3c3-4758e1fecd1d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.074980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95961281-b1c9-4d85-b3c3-4758e1fecd1d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.075462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95961281-b1c9-4d85-b3c3-4758e1fecd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:52.150016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-95961281-b1c9-4d85-b3c3-4758e1fecd1d None None] MFA Rules not processed for user `d9bfef842672407c992c59ca51329f53`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:52.151890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-95961281-b1c9-4d85-b3c3-4758e1fecd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:52.185790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 919/1839] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:51 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:52.189595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220baf6a-27f3-40b4-becd-ac6351a92836 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:52.334530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 921/1840] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:52.345631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95961281-b1c9-4d85-b3c3-4758e1fecd1d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:52.345982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220baf6a-27f3-40b4-becd-ac6351a92836 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:52.361607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8b96f-3b44-4c06-a805-8fea7e961df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:52.369203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8b96f-3b44-4c06-a805-8fea7e961df9 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.369203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8b96f-3b44-4c06-a805-8fea7e961df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.369203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8b96f-3b44-4c06-a805-8fea7e961df9 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:52.369203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8b96f-3b44-4c06-a805-8fea7e961df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:52.369203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8b96f-3b44-4c06-a805-8fea7e961df9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:52.515333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95961281-b1c9-4d85-b3c3-4758e1fecd1d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:52.533156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 920/1841] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:52 2022] POST /identity/v3/users => generated 285 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:52.533580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b340fe-f456-4024-82e5-433be1cb9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:52.535055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b340fe-f456-4024-82e5-433be1cb9e97 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.536964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8b96f-3b44-4c06-a805-8fea7e961df9 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:52.538729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b340fe-f456-4024-82e5-433be1cb9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.539098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b340fe-f456-4024-82e5-433be1cb9e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:52.547902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b340fe-f456-4024-82e5-433be1cb9e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:52.553498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b340fe-f456-4024-82e5-433be1cb9e97 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:52.564780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8b96f-3b44-4c06-a805-8fea7e961df9 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:52.572722 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f9841-6249-4d72-8459-1018b2a6cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:52.574584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f9841-6249-4d72-8459-1018b2a6cb0e admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.575902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f9841-6249-4d72-8459-1018b2a6cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.576725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f9841-6249-4d72-8459-1018b2a6cb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:52.580825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f9841-6249-4d72-8459-1018b2a6cb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:52.589473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f9841-6249-4d72-8459-1018b2a6cb0e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:52.625199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 921/1842] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:52.628807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f9841-6249-4d72-8459-1018b2a6cb0e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:52.650935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f9841-6249-4d72-8459-1018b2a6cb0e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:52.673483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 922/1843] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:52 2022] POST /identity/v3/projects => generated 399 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:52.675867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df883221-8e34-4e39-8ad7-bca2210a0480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:52.677079 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df883221-8e34-4e39-8ad7-bca2210a0480 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.677585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df883221-8e34-4e39-8ad7-bca2210a0480 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.681169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b340fe-f456-4024-82e5-433be1cb9e97 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:52.683879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df883221-8e34-4e39-8ad7-bca2210a0480 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:52.688031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df883221-8e34-4e39-8ad7-bca2210a0480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:52.690383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df883221-8e34-4e39-8ad7-bca2210a0480 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:52.715476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 922/1844] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:52.718952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df883221-8e34-4e39-8ad7-bca2210a0480 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:52.758588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df883221-8e34-4e39-8ad7-bca2210a0480 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:52.826261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:52.836664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:52.946666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b340fe-f456-4024-82e5-433be1cb9e97 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:52.966513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19063c3-01c3-453b-b865-7cdbaac0169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:52.967563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19063c3-01c3-453b-b865-7cdbaac0169a admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.967935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19063c3-01c3-453b-b865-7cdbaac0169a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.971819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19063c3-01c3-453b-b865-7cdbaac0169a admin admin] PATH_INFO: `/v3/projects/99043c18ce7945a8956a4d6c3c4ad57b/users/86ab14c9cee248ba92376a6ea247b08b/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:52.971936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2211c7c-c418-4b29-95ba-f20e35f8b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:52.971936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211c7c-c418-4b29-95ba-f20e35f8b269 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.971936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211c7c-c418-4b29-95ba-f20e35f8b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.971936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211c7c-c418-4b29-95ba-f20e35f8b269 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:52.972314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2211c7c-c418-4b29-95ba-f20e35f8b269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:52.972722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2211c7c-c418-4b29-95ba-f20e35f8b269 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:53.010927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19063c3-01c3-453b-b865-7cdbaac0169a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99043c18ce7945a8956a4d6c3c4ad57b, user_id=86ab14c9cee248ba92376a6ea247b08b, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:53.010927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19063c3-01c3-453b-b865-7cdbaac0169a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:53.093683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 923/1845] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:52 2022] POST /identity/v3/users => generated 306 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:53.100079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2211c7c-c418-4b29-95ba-f20e35f8b269 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:53.121591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2211c7c-c418-4b29-95ba-f20e35f8b269 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:53.147997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 923/1846] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:52 2022] PUT /identity/v3/projects/99043c18ce7945a8956a4d6c3c4ad57b/users/86ab14c9cee248ba92376a6ea247b08b/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:53.163192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0817da-91a7-4829-a9fb-fd55793ada4b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:53.163796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0817da-91a7-4829-a9fb-fd55793ada4b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:53.164248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0817da-91a7-4829-a9fb-fd55793ada4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:53.215869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd309ba5-5fe6-4b9f-a2eb-87c2cffa3731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:53.216868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309ba5-5fe6-4b9f-a2eb-87c2cffa3731 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:53.217162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309ba5-5fe6-4b9f-a2eb-87c2cffa3731 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:53.217619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309ba5-5fe6-4b9f-a2eb-87c2cffa3731 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:53.218835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd309ba5-5fe6-4b9f-a2eb-87c2cffa3731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:53.221369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd309ba5-5fe6-4b9f-a2eb-87c2cffa3731 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:53.221567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9c0817da-91a7-4829-a9fb-fd55793ada4b None None] MFA Rules not processed for user `86ab14c9cee248ba92376a6ea247b08b`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:53.222942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9c0817da-91a7-4829-a9fb-fd55793ada4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:53.238300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 924/1847] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:53.240408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd309ba5-5fe6-4b9f-a2eb-87c2cffa3731 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:53.253496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd309ba5-5fe6-4b9f-a2eb-87c2cffa3731 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:53.262691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814a26-21a9-4b22-874a-d401f0718747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:53.262691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814a26-21a9-4b22-874a-d401f0718747 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:53.263846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814a26-21a9-4b22-874a-d401f0718747 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:53.264266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814a26-21a9-4b22-874a-d401f0718747 admin admin] PATH_INFO: `/v3/projects/4c3fb877a65f49a4b82c54eae78cd420/users/ab4632ec4563463a8125ae502972a654/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:53.287028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11814a26-21a9-4b22-874a-d401f0718747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3fb877a65f49a4b82c54eae78cd420, user_id=ab4632ec4563463a8125ae502972a654, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:53.291341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11814a26-21a9-4b22-874a-d401f0718747 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:53.357743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 924/1848] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:53.361932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0817da-91a7-4829-a9fb-fd55793ada4b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:53.386214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 925/1849] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:53 2022] PUT /identity/v3/projects/4c3fb877a65f49a4b82c54eae78cd420/users/ab4632ec4563463a8125ae502972a654/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:53.387237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814a26-21a9-4b22-874a-d401f0718747 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:53.392696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0817da-91a7-4829-a9fb-fd55793ada4b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:53.530842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1161e-c749-45c5-80cb-a8d3c255496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:53.531771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1161e-c749-45c5-80cb-a8d3c255496c admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:53.532244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1161e-c749-45c5-80cb-a8d3c255496c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:53.532590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1161e-c749-45c5-80cb-a8d3c255496c admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:53.533755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1161e-c749-45c5-80cb-a8d3c255496c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:53.542661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1161e-c749-45c5-80cb-a8d3c255496c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:53.572537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814a26-21a9-4b22-874a-d401f0718747 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:53.578676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83ae2-dce6-4c6c-a380-16554946dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:53.579624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83ae2-dce6-4c6c-a380-16554946dfce admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:53.580280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83ae2-dce6-4c6c-a380-16554946dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:53.580723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83ae2-dce6-4c6c-a380-16554946dfce admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:53.586327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed83ae2-dce6-4c6c-a380-16554946dfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:53.591263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed83ae2-dce6-4c6c-a380-16554946dfce admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:53.618550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 926/1850] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:53.629122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83ae2-dce6-4c6c-a380-16554946dfce admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:53.644864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83ae2-dce6-4c6c-a380-16554946dfce admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:53.690925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 925/1851] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:53 2022] POST /identity/v3/projects => generated 369 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:53.693607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4984d5-c45f-47f1-ac17-e3ca7073f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:53.695007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4984d5-c45f-47f1-ac17-e3ca7073f205 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:53.697108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4984d5-c45f-47f1-ac17-e3ca7073f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:53.697108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4984d5-c45f-47f1-ac17-e3ca7073f205 admin admin] PATH_INFO: `/v3/projects/4c3fb877a65f49a4b82c54eae78cd420/users/ab4632ec4563463a8125ae502972a654/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:53.700415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1161e-c749-45c5-80cb-a8d3c255496c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:53.707685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4984d5-c45f-47f1-ac17-e3ca7073f205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3fb877a65f49a4b82c54eae78cd420, user_id=ab4632ec4563463a8125ae502972a654, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:53.717630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4984d5-c45f-47f1-ac17-e3ca7073f205 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:53.778554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 927/1852] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:53 2022] PUT /identity/v3/projects/4c3fb877a65f49a4b82c54eae78cd420/users/ab4632ec4563463a8125ae502972a654/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:53.782724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:53.791889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bb275-0766-4889-be5d-0708bdce2fa3 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:53.792471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bb275-0766-4889-be5d-0708bdce2fa3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:53.797475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bb275-0766-4889-be5d-0708bdce2fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:53.839845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:53.858406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ad3bb275-0766-4889-be5d-0708bdce2fa3 None None] MFA Rules not processed for user `ab4632ec4563463a8125ae502972a654`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:53.866138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ad3bb275-0766-4889-be5d-0708bdce2fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:53.896033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1161e-c749-45c5-80cb-a8d3c255496c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:54.024647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:54.025573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:54.026128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:54.026543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:54.028612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:54.031484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:54.071609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 928/1853] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:54.077305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bb275-0766-4889-be5d-0708bdce2fa3 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:54.079925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ad3bb275-0766-4889-be5d-0708bdce2fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:54.120975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bb275-0766-4889-be5d-0708bdce2fa3 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:54.128393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:54.129558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:54.129853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:54.130226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] PATH_INFO: `/v3/users/b200c810e6114fd7a26c18817d8717fa` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:54.131606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b200c810e6114fd7a26c18817d8717fa)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:54.133858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:54.204539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 926/1854] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:53 2022] POST /identity/v3/users => generated 291 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:54.206068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:54.212904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:54.412316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da55861-3f24-4edf-9133-d1b65f07ead1 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:54.425694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9bcdb-a06e-43ea-a308-3781c76c9045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:54.426698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9bcdb-a06e-43ea-a308-3781c76c9045 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:54.430219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9bcdb-a06e-43ea-a308-3781c76c9045 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:54.432149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9bcdb-a06e-43ea-a308-3781c76c9045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:54.445431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b200c810e6114fd7a26c18817d8717fa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:54.529982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b200c810e6114fd7a26c18817d8717fa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:54.553788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b200c810e6114fd7a26c18817d8717fa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:54.572151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b200c810e6114fd7a26c18817d8717fa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:54.578523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b200c810e6114fd7a26c18817d8717fa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:54.597845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 929/1855] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:54 2022] DELETE /identity/v3/users/b200c810e6114fd7a26c18817d8717fa => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:54.604374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:54.607568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9bcdb-a06e-43ea-a308-3781c76c9045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:54.611632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9bcdb-a06e-43ea-a308-3781c76c9045 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:54.611825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:54.650783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 927/1856] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:54.657461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfbf41-becb-45ba-8f7d-a30405dcda46 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:54.660139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfbf41-becb-45ba-8f7d-a30405dcda46 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:54.661869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfbf41-becb-45ba-8f7d-a30405dcda46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:54.721928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-74dfbf41-becb-45ba-8f7d-a30405dcda46 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:54.723559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-74dfbf41-becb-45ba-8f7d-a30405dcda46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:54.750992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:54.834278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e430bd-2ee3-4fff-96e3-0f82a27453f6 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:54.840078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54588-6294-4e33-9432-4019645394bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:54.840774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54588-6294-4e33-9432-4019645394bb admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:54.841059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54588-6294-4e33-9432-4019645394bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:54.841343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54588-6294-4e33-9432-4019645394bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:54.842081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c54588-6294-4e33-9432-4019645394bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:54.843795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c54588-6294-4e33-9432-4019645394bb admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:54.864503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 930/1857] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:54.864503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54588-6294-4e33-9432-4019645394bb admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:54.876985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:54.887631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54588-6294-4e33-9432-4019645394bb admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:54.894916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98732-2ba6-468a-ba07-66c29a6bbb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:54.896063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98732-2ba6-468a-ba07-66c29a6bbb46 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:54.896611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98732-2ba6-468a-ba07-66c29a6bbb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:54.897525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98732-2ba6-468a-ba07-66c29a6bbb46 admin admin] PATH_INFO: `/v3/projects/029ef5a6bee9445ca13638f5de2d90bc/users/3f3c7449b7b44ee193d8ef27c3f9a1a8/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:54.921999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b98732-2ba6-468a-ba07-66c29a6bbb46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029ef5a6bee9445ca13638f5de2d90bc, user_id=3f3c7449b7b44ee193d8ef27c3f9a1a8, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:54.925721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b98732-2ba6-468a-ba07-66c29a6bbb46 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:54.929392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 928/1858] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:54.960926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfbf41-becb-45ba-8f7d-a30405dcda46 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:54.962682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-74dfbf41-becb-45ba-8f7d-a30405dcda46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:55.009591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 931/1859] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:54 2022] PUT /identity/v3/projects/029ef5a6bee9445ca13638f5de2d90bc/users/3f3c7449b7b44ee193d8ef27c3f9a1a8/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:55.014360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98732-2ba6-468a-ba07-66c29a6bbb46 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:55.083388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfbf41-becb-45ba-8f7d-a30405dcda46 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:55.123742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98732-2ba6-468a-ba07-66c29a6bbb46 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:55.131544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c0fb3-e36d-4b10-a9d7-03343a342ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:55.132534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c0fb3-e36d-4b10-a9d7-03343a342ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:55.133163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c0fb3-e36d-4b10-a9d7-03343a342ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:55.133747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c0fb3-e36d-4b10-a9d7-03343a342ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:55.135116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c0fb3-e36d-4b10-a9d7-03343a342ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:55.138223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c0fb3-e36d-4b10-a9d7-03343a342ca4 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:55.153305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 932/1860] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:55.159539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c0fb3-e36d-4b10-a9d7-03343a342ca4 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:55.176859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c0fb3-e36d-4b10-a9d7-03343a342ca4 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:55.185116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432147-9a2f-4308-8ed2-7184edb91222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:55.186730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432147-9a2f-4308-8ed2-7184edb91222 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:55.187311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432147-9a2f-4308-8ed2-7184edb91222 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:55.187794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432147-9a2f-4308-8ed2-7184edb91222 admin admin] PATH_INFO: `/v3/projects/029ef5a6bee9445ca13638f5de2d90bc/users/3f3c7449b7b44ee193d8ef27c3f9a1a8/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:55.191691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37432147-9a2f-4308-8ed2-7184edb91222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029ef5a6bee9445ca13638f5de2d90bc, user_id=3f3c7449b7b44ee193d8ef27c3f9a1a8, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:55.197928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37432147-9a2f-4308-8ed2-7184edb91222 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:55.206737 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f67a7-537a-44f6-a08f-45deb73b9938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:55.207442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f67a7-537a-44f6-a08f-45deb73b9938 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:55.207702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f67a7-537a-44f6-a08f-45deb73b9938 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:55.208049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f67a7-537a-44f6-a08f-45deb73b9938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:55.216981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 933/1861] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:55 2022] PUT /identity/v3/projects/029ef5a6bee9445ca13638f5de2d90bc/users/3f3c7449b7b44ee193d8ef27c3f9a1a8/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:53:55.227849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743f74-00c5-415c-a829-7767ee3fa391 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:55.228389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743f74-00c5-415c-a829-7767ee3fa391 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:55.229051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743f74-00c5-415c-a829-7767ee3fa391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:55.239040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f67a7-537a-44f6-a08f-45deb73b9938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:55.241054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f67a7-537a-44f6-a08f-45deb73b9938 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:55.255014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 929/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:53:55.281260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-a4743f74-00c5-415c-a829-7767ee3fa391 None None] MFA Rules not processed for user `3f3c7449b7b44ee193d8ef27c3f9a1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:55.282915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a4743f74-00c5-415c-a829-7767ee3fa391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:55.387690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 934/1863] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:55.472765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f67a7-537a-44f6-a08f-45deb73b9938 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:55.484975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f67a7-537a-44f6-a08f-45deb73b9938 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:55.580640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:55.581544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:55.582190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:55.584165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:55.623333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:55.628797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:55.689723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 930/1864] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:56.343747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4743f74-00c5-415c-a829-7767ee3fa391 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:56.345567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a4743f74-00c5-415c-a829-7767ee3fa391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:56.456163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:56.503698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4743f74-00c5-415c-a829-7767ee3fa391 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:56.526715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:56.527933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:56.529618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:56.531140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] PATH_INFO: `/v3/users/aaddfdaef98f40568252faf626550cb6` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:56.531946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaddfdaef98f40568252faf626550cb6)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:56.536042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:56.670142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:56.671864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:56.697113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:56.787465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd64df-1760-4ca7-bbc2-b0760db86ac8 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:56.794358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaddfdaef98f40568252faf626550cb6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:56.814876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:56.814876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:56.814876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:56.814876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:56.816137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:56.856334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaddfdaef98f40568252faf626550cb6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:56.885178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaddfdaef98f40568252faf626550cb6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:56.906177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaddfdaef98f40568252faf626550cb6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:56.907819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaddfdaef98f40568252faf626550cb6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:56.927285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 935/1865] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:56 2022] DELETE /identity/v3/users/aaddfdaef98f40568252faf626550cb6 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:56.973118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:56.975423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:57.003820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 931/1866] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:57.433655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:57.436280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:57.637897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcd23f-7bc1-4d83-9dd0-57c268d77f56 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:57.663361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:57.669549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:57.669975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:57.670294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] PATH_INFO: `/v3/projects/ab35feede49d44d6b1e51c47399aab42` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:57.671942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab35feede49d44d6b1e51c47399aab42)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:57.674351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:57.891747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab35feede49d44d6b1e51c47399aab42', 'request_id': 'req-58accc7a-45ef-4e57-886f-c5f105251e5b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:57.975775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab35feede49d44d6b1e51c47399aab42', 'request_id': 'req-58accc7a-45ef-4e57-886f-c5f105251e5b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:57.984406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab35feede49d44d6b1e51c47399aab42', 'request_id': 'req-58accc7a-45ef-4e57-886f-c5f105251e5b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.001889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:58.010061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] The token cache is being invalidate because project ab35feede49d44d6b1e51c47399aab42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:58.015013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.015013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.018012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 936/1867] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:57 2022] DELETE /identity/v3/projects/ab35feede49d44d6b1e51c47399aab42 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:58.022437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:58.023937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:58.051906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0402e7e-24e8-4401-94b9-5837658af33e service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:58.211745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:58.212663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:58.212953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:58.213236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] PATH_INFO: `/v3/users/54e26fe6a43b49dcb776c92894ed56f6` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:58.214567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e26fe6a43b49dcb776c92894ed56f6)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:58.216569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:58.480105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:58.493959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e26fe6a43b49dcb776c92894ed56f6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.588039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e26fe6a43b49dcb776c92894ed56f6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.641926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e26fe6a43b49dcb776c92894ed56f6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.644783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e26fe6a43b49dcb776c92894ed56f6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.677490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b4dfd680-a752-4850-a48f-be864be2e06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e26fe6a43b49dcb776c92894ed56f6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.688438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 932/1868] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:58 2022] DELETE /identity/v3/users/54e26fe6a43b49dcb776c92894ed56f6 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:59.021919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.023585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.050234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58accc7a-45ef-4e57-886f-c5f105251e5b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.285548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.287625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.288164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.288605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] PATH_INFO: `/v3/projects/cfa64f50e0a945019c80be11c782d06f` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.291589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa64f50e0a945019c80be11c782d06f)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.293889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.484530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa64f50e0a945019c80be11c782d06f', 'request_id': 'req-08e9a8bb-baf2-4d7a-9b1d-329459438232'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.571184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa64f50e0a945019c80be11c782d06f', 'request_id': 'req-08e9a8bb-baf2-4d7a-9b1d-329459438232'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.586644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa64f50e0a945019c80be11c782d06f', 'request_id': 'req-08e9a8bb-baf2-4d7a-9b1d-329459438232'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.634485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] The token cache is being invalidate because project cfa64f50e0a945019c80be11c782d06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:59.634988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.637049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.648044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 937/1869] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:59 2022] DELETE /identity/v3/projects/cfa64f50e0a945019c80be11c782d06f => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:59.650265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee075-ba6a-42ac-9d4a-214dc4d2567d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.650716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee075-ba6a-42ac-9d4a-214dc4d2567d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.650822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee075-ba6a-42ac-9d4a-214dc4d2567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.704664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d86ee075-ba6a-42ac-9d4a-214dc4d2567d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:59.706519 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d86ee075-ba6a-42ac-9d4a-214dc4d2567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.852349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.854504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.860675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 933/1870] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:53:59.873583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd27b83-0e00-4aa5-a78c-0239d03f1b58 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.873880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd27b83-0e00-4aa5-a78c-0239d03f1b58 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.874190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd27b83-0e00-4aa5-a78c-0239d03f1b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.884169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a8bb-baf2-4d7a-9b1d-329459438232 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.896083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.897773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.898411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.905947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] PATH_INFO: `/v3/projects/17b6af816df640d282a5b353fab11eec` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.905947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b6af816df640d282a5b353fab11eec)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.905947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.917324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4bd27b83-0e00-4aa5-a78c-0239d03f1b58 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:59.922425 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4bd27b83-0e00-4aa5-a78c-0239d03f1b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.942035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 934/1871] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:53:59.947015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd27b83-0e00-4aa5-a78c-0239d03f1b58 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.962568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd27b83-0e00-4aa5-a78c-0239d03f1b58 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.976656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.978559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.979739 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.980428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.981476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:53:59.982447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.983791 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.024448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 935/1872] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:54:00.029793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.056629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654590e-aa85-4787-905a-16b308d4a22a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.087897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b6af816df640d282a5b353fab11eec', 'request_id': 'req-25543f37-39a7-42d8-aea5-6f247a2fc4c7'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.159737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b6af816df640d282a5b353fab11eec', 'request_id': 'req-25543f37-39a7-42d8-aea5-6f247a2fc4c7'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.167370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b6af816df640d282a5b353fab11eec', 'request_id': 'req-25543f37-39a7-42d8-aea5-6f247a2fc4c7'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.199383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] The token cache is being invalidate because project 17b6af816df640d282a5b353fab11eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:00.199724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.201290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-25543f37-39a7-42d8-aea5-6f247a2fc4c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.203669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 938/1873] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:59 2022] DELETE /identity/v3/projects/17b6af816df640d282a5b353fab11eec => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:00.208788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f3a2-c5bb-4d25-9c51-1ce21f6ec185 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.209513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f3a2-c5bb-4d25-9c51-1ce21f6ec185 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.209975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f3a2-c5bb-4d25-9c51-1ce21f6ec185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.221988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.222946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.223235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.223515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.224221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.232278 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.237193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f1d9f3a2-c5bb-4d25-9c51-1ce21f6ec185 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:00.238919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f1d9f3a2-c5bb-4d25-9c51-1ce21f6ec185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:00.250661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 939/1874] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:00.261570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc1f4-3203-4392-b9ae-f4cfc199137f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.263492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc1f4-3203-4392-b9ae-f4cfc199137f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.264965 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc1f4-3203-4392-b9ae-f4cfc199137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.283045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:00.297029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4e4cc1f4-3203-4392-b9ae-f4cfc199137f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:00.301132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4e4cc1f4-3203-4392-b9ae-f4cfc199137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:00.312666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 940/1875] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:00.316710 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cc1f4-3203-4392-b9ae-f4cfc199137f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.328807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cc1f4-3203-4392-b9ae-f4cfc199137f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.348675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.359253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 936/1876] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:00 2022] POST /identity/v3/projects => generated 391 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:00.359453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.359453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.359453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.359453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:00.359453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.360054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.360215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.360356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:00.394401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 941/1877] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:00.399594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.424644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f07de5-5eb9-449f-aaed-67721f01fa91 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.441270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:00.516368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1e36c-1116-4cc8-87c2-ddefc05c4e26 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.528527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e18-dcce-497f-af8e-ac78be193604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.529246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e18-dcce-497f-af8e-ac78be193604 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.529516 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e18-dcce-497f-af8e-ac78be193604 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.529800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e18-dcce-497f-af8e-ac78be193604 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.530536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f9e18-dcce-497f-af8e-ac78be193604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.532502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f9e18-dcce-497f-af8e-ac78be193604 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.554704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f9761-c972-4879-829d-53abad65c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.555289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f9761-c972-4879-829d-53abad65c1ad admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.555584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f9761-c972-4879-829d-53abad65c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.556354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f9761-c972-4879-829d-53abad65c1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.556570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f9761-c972-4879-829d-53abad65c1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.558851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f9761-c972-4879-829d-53abad65c1ad admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.652787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 937/1878] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:00 2022] POST /identity/v3/users => generated 296 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:00.660509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e18-dcce-497f-af8e-ac78be193604 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.670746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 942/1879] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:00 2022] POST /identity/v3/projects => generated 391 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:00.675595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f9761-c972-4879-829d-53abad65c1ad admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.685051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e18-dcce-497f-af8e-ac78be193604 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.865148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f9761-c972-4879-829d-53abad65c1ad admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.870628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb176ea-e388-48ee-80ae-783146a789f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.871591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9044dc-251d-4f43-9209-f8ed7b923413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.871860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb176ea-e388-48ee-80ae-783146a789f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.872247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb176ea-e388-48ee-80ae-783146a789f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.872354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9044dc-251d-4f43-9209-f8ed7b923413 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.872629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9044dc-251d-4f43-9209-f8ed7b923413 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.872732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb176ea-e388-48ee-80ae-783146a789f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.872907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9044dc-251d-4f43-9209-f8ed7b923413 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.875601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb176ea-e388-48ee-80ae-783146a789f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.876403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9044dc-251d-4f43-9209-f8ed7b923413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.877814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb176ea-e388-48ee-80ae-783146a789f5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.881056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9044dc-251d-4f43-9209-f8ed7b923413 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.907902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 938/1880] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:54:00.909144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb176ea-e388-48ee-80ae-783146a789f5 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.927043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb176ea-e388-48ee-80ae-783146a789f5 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.933122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4f3f8-eac3-4684-a1e2-2b92c664b710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.933780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f3f8-eac3-4684-a1e2-2b92c664b710 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.934584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f3f8-eac3-4684-a1e2-2b92c664b710 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.934970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f3f8-eac3-4684-a1e2-2b92c664b710 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.935916 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4f3f8-eac3-4684-a1e2-2b92c664b710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.937709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4f3f8-eac3-4684-a1e2-2b92c664b710 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.953912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 939/1881] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:00.955162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4f3f8-eac3-4684-a1e2-2b92c664b710 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.970302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4f3f8-eac3-4684-a1e2-2b92c664b710 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.977233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ad9d-c081-48b5-8f6f-92c7ffdb6024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.978513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ad9d-c081-48b5-8f6f-92c7ffdb6024 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.979853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ad9d-c081-48b5-8f6f-92c7ffdb6024 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.979853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ad9d-c081-48b5-8f6f-92c7ffdb6024 admin admin] PATH_INFO: `/v3/projects/0bdaa53ac4ca44d9a4d1016f748c9892/users/62c293b965474e4a8331ed615914c9eb/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.010878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 943/1882] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:00 2022] POST /identity/v3/users => generated 296 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:01.011037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ad9d-c081-48b5-8f6f-92c7ffdb6024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdaa53ac4ca44d9a4d1016f748c9892, user_id=62c293b965474e4a8331ed615914c9eb, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.012486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9044dc-251d-4f43-9209-f8ed7b923413 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.022707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ad9d-c081-48b5-8f6f-92c7ffdb6024 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.046474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9044dc-251d-4f43-9209-f8ed7b923413 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.076938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641e64-d9cc-43de-80f8-44d9e984bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.080909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641e64-d9cc-43de-80f8-44d9e984bc55 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.081174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641e64-d9cc-43de-80f8-44d9e984bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.082869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641e64-d9cc-43de-80f8-44d9e984bc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.083743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641e64-d9cc-43de-80f8-44d9e984bc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.089474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641e64-d9cc-43de-80f8-44d9e984bc55 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.119123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 944/1883] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:54:01.123640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641e64-d9cc-43de-80f8-44d9e984bc55 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.138888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 940/1884] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:00 2022] PUT /identity/v3/projects/0bdaa53ac4ca44d9a4d1016f748c9892/users/62c293b965474e4a8331ed615914c9eb/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:01.147195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641e64-d9cc-43de-80f8-44d9e984bc55 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.154159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335d5f-b3b5-43bd-9fd9-77ab3e1d7f5b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.154459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335d5f-b3b5-43bd-9fd9-77ab3e1d7f5b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.154924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335d5f-b3b5-43bd-9fd9-77ab3e1d7f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.209748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-5b335d5f-b3b5-43bd-9fd9-77ab3e1d7f5b None None] MFA Rules not processed for user `62c293b965474e4a8331ed615914c9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:01.214945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5b335d5f-b3b5-43bd-9fd9-77ab3e1d7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:01.263968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:01.297397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4154b6-270f-4a9f-897f-eb2d79695478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.298331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4154b6-270f-4a9f-897f-eb2d79695478 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.298776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4154b6-270f-4a9f-897f-eb2d79695478 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.299107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4154b6-270f-4a9f-897f-eb2d79695478 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.300752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4154b6-270f-4a9f-897f-eb2d79695478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.303352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4154b6-270f-4a9f-897f-eb2d79695478 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.320919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 945/1885] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:01.324132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4154b6-270f-4a9f-897f-eb2d79695478 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.341673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4154b6-270f-4a9f-897f-eb2d79695478 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.344278 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 941/1886] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:01.348927 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b335d5f-b3b5-43bd-9fd9-77ab3e1d7f5b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.350365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf1286-125e-4f58-a783-8b4304f67205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.352231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf1286-125e-4f58-a783-8b4304f67205 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.352551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf1286-125e-4f58-a783-8b4304f67205 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.354060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf1286-125e-4f58-a783-8b4304f67205 admin admin] PATH_INFO: `/v3/projects/44a241ef87f643d186ba4d699a0c302c/users/81bf33dbc1694b218d8c51272a22119d/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.370897 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b335d5f-b3b5-43bd-9fd9-77ab3e1d7f5b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.376807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affd070-efc6-4bed-beb6-ef54d8c6114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.377716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd070-efc6-4bed-beb6-ef54d8c6114b admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.378512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd070-efc6-4bed-beb6-ef54d8c6114b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.378976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd070-efc6-4bed-beb6-ef54d8c6114b admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.380173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affd070-efc6-4bed-beb6-ef54d8c6114b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.383172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affd070-efc6-4bed-beb6-ef54d8c6114b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.384621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf1286-125e-4f58-a783-8b4304f67205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a241ef87f643d186ba4d699a0c302c, user_id=81bf33dbc1694b218d8c51272a22119d, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.387822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf1286-125e-4f58-a783-8b4304f67205 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.389937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:01.463427 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 946/1887] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:01 2022] PUT /identity/v3/projects/44a241ef87f643d186ba4d699a0c302c/users/81bf33dbc1694b218d8c51272a22119d/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:01.476336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316d2e-b243-4f12-b097-cb82e971487b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.476679 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316d2e-b243-4f12-b097-cb82e971487b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.476905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316d2e-b243-4f12-b097-cb82e971487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.495538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 942/1888] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:01 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:01.501101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affd070-efc6-4bed-beb6-ef54d8c6114b admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.575034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ea316d2e-b243-4f12-b097-cb82e971487b None None] MFA Rules not processed for user `81bf33dbc1694b218d8c51272a22119d`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:01.580998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ea316d2e-b243-4f12-b097-cb82e971487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:01.729663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affd070-efc6-4bed-beb6-ef54d8c6114b admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.737377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6fab9-7b3e-4e01-8109-43f09f348431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.739661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6fab9-7b3e-4e01-8109-43f09f348431 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.740625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6fab9-7b3e-4e01-8109-43f09f348431 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.741090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6fab9-7b3e-4e01-8109-43f09f348431 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.742236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6fab9-7b3e-4e01-8109-43f09f348431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.745513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6fab9-7b3e-4e01-8109-43f09f348431 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.802463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 947/1889] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:01.807780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea316d2e-b243-4f12-b097-cb82e971487b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.820892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea316d2e-b243-4f12-b097-cb82e971487b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.828098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f160-891c-4cf9-ace6-c3b27bc8143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.828816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f160-891c-4cf9-ace6-c3b27bc8143a admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.829674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f160-891c-4cf9-ace6-c3b27bc8143a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.829674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f160-891c-4cf9-ace6-c3b27bc8143a admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.830341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926f160-891c-4cf9-ace6-c3b27bc8143a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.832313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926f160-891c-4cf9-ace6-c3b27bc8143a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.894521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 943/1890] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:01 2022] POST /identity/v3/users => generated 302 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:01.895734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6fab9-7b3e-4e01-8109-43f09f348431 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.912942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6fab9-7b3e-4e01-8109-43f09f348431 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.937976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 948/1891] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:01 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:01.940099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eee6d-e345-4d87-8604-19fad9833c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.941657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f160-891c-4cf9-ace6-c3b27bc8143a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.944215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eee6d-e345-4d87-8604-19fad9833c9b admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.946267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eee6d-e345-4d87-8604-19fad9833c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.947321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eee6d-e345-4d87-8604-19fad9833c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.949747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eee6d-e345-4d87-8604-19fad9833c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.954003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eee6d-e345-4d87-8604-19fad9833c9b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.992944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 944/1892] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:01.995274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eee6d-e345-4d87-8604-19fad9833c9b admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:02.041528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eee6d-e345-4d87-8604-19fad9833c9b admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:02.055006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b271bd-5d7b-4ea4-904e-84ef1544c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:02.055460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f160-891c-4cf9-ace6-c3b27bc8143a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:02.056223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b271bd-5d7b-4ea4-904e-84ef1544c050 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.056223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b271bd-5d7b-4ea4-904e-84ef1544c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.056495 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b271bd-5d7b-4ea4-904e-84ef1544c050 admin admin] PATH_INFO: `/v3/projects/a0713024fb3a4744bd4935be61054dee/users/5d6819b15a1740bd9bf8fb0730f5e44a/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.069756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b7b60-f441-4f83-a673-6df89171ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:02.070587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7b60-f441-4f83-a673-6df89171ede4 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.070984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7b60-f441-4f83-a673-6df89171ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.071368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7b60-f441-4f83-a673-6df89171ede4 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.072221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b7b60-f441-4f83-a673-6df89171ede4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:02.074871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b7b60-f441-4f83-a673-6df89171ede4 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:02.094639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b271bd-5d7b-4ea4-904e-84ef1544c050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0713024fb3a4744bd4935be61054dee, user_id=5d6819b15a1740bd9bf8fb0730f5e44a, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:02.097330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b271bd-5d7b-4ea4-904e-84ef1544c050 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:02.200448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 949/1893] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:01 2022] POST /identity/v3/users => generated 303 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:02.204366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b7b60-f441-4f83-a673-6df89171ede4 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:02.209393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 945/1894] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:01 2022] PUT /identity/v3/projects/a0713024fb3a4744bd4935be61054dee/users/5d6819b15a1740bd9bf8fb0730f5e44a/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:02.216979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b271bd-5d7b-4ea4-904e-84ef1544c050 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:02.220288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b7b60-f441-4f83-a673-6df89171ede4 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:02.268041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:02.383750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b271bd-5d7b-4ea4-904e-84ef1544c050 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:02.384771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8248b4-0e57-4b25-bd09-e3248390d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:02.385788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8248b4-0e57-4b25-bd09-e3248390d99a admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.386569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8248b4-0e57-4b25-bd09-e3248390d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.387016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8248b4-0e57-4b25-bd09-e3248390d99a admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.388098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8248b4-0e57-4b25-bd09-e3248390d99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:02.389983 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8248b4-0e57-4b25-bd09-e3248390d99a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:02.400319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7b63b-6e64-4119-8ff7-1abb8311543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:02.401166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b63b-6e64-4119-8ff7-1abb8311543e admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.401549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b63b-6e64-4119-8ff7-1abb8311543e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.402157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b63b-6e64-4119-8ff7-1abb8311543e admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.403171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7b63b-6e64-4119-8ff7-1abb8311543e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:02.405960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7b63b-6e64-4119-8ff7-1abb8311543e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:02.418584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 950/1895] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:02.422853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8248b4-0e57-4b25-bd09-e3248390d99a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:02.425349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 946/1896] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:02.426349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7b63b-6e64-4119-8ff7-1abb8311543e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:02.441775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7b63b-6e64-4119-8ff7-1abb8311543e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:02.444499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8248b4-0e57-4b25-bd09-e3248390d99a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:02.452338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c313a-5c90-4ef7-81f9-4b6c3dfcdc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:02.453529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c313a-5c90-4ef7-81f9-4b6c3dfcdc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.454045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c313a-5c90-4ef7-81f9-4b6c3dfcdc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.454588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c313a-5c90-4ef7-81f9-4b6c3dfcdc2c admin admin] PATH_INFO: `/v3/projects/d6254bf7ad8e472ba96e7deb7af1df4f/users/09e19195b2d34f038fbf1e7cf094935d/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.463037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d2f57-f9b8-43c0-8b83-324a29d85585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:02.463959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d2f57-f9b8-43c0-8b83-324a29d85585 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.464248 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d2f57-f9b8-43c0-8b83-324a29d85585 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.464564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d2f57-f9b8-43c0-8b83-324a29d85585 admin admin] PATH_INFO: `/v3/projects/a0713024fb3a4744bd4935be61054dee/users/5d6819b15a1740bd9bf8fb0730f5e44a/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.466900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d2f57-f9b8-43c0-8b83-324a29d85585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0713024fb3a4744bd4935be61054dee, user_id=5d6819b15a1740bd9bf8fb0730f5e44a, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:02.469772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d2f57-f9b8-43c0-8b83-324a29d85585 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:02.499291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 947/1897] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:02 2022] PUT /identity/v3/projects/a0713024fb3a4744bd4935be61054dee/users/5d6819b15a1740bd9bf8fb0730f5e44a/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:02.501783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd984-9d84-4d49-87bb-07e14dc2c604 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.502090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd984-9d84-4d49-87bb-07e14dc2c604 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.505522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c313a-5c90-4ef7-81f9-4b6c3dfcdc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6254bf7ad8e472ba96e7deb7af1df4f, user_id=09e19195b2d34f038fbf1e7cf094935d, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:02.506300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd984-9d84-4d49-87bb-07e14dc2c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.509107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c313a-5c90-4ef7-81f9-4b6c3dfcdc2c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:02.546137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0bcfd984-9d84-4d49-87bb-07e14dc2c604 None None] MFA Rules not processed for user `5d6819b15a1740bd9bf8fb0730f5e44a`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:02.547762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0bcfd984-9d84-4d49-87bb-07e14dc2c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:02.565595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:02.670668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 948/1898] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:02.681274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd984-9d84-4d49-87bb-07e14dc2c604 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:02.685447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0bcfd984-9d84-4d49-87bb-07e14dc2c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:02.779015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd984-9d84-4d49-87bb-07e14dc2c604 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:02.785870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e77fe0-5303-4814-9981-aabcff1ea0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:02.787486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e77fe0-5303-4814-9981-aabcff1ea0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.788190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e77fe0-5303-4814-9981-aabcff1ea0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.788613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e77fe0-5303-4814-9981-aabcff1ea0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.844315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 951/1899] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:02 2022] PUT /identity/v3/projects/d6254bf7ad8e472ba96e7deb7af1df4f/users/09e19195b2d34f038fbf1e7cf094935d/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:02.848579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c313a-5c90-4ef7-81f9-4b6c3dfcdc2c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:02.923171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e77fe0-5303-4814-9981-aabcff1ea0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:02.928224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e77fe0-5303-4814-9981-aabcff1ea0c3 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:02.959964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 949/1900] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:02.990804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c313a-5c90-4ef7-81f9-4b6c3dfcdc2c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.002337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac842f9-4458-4db0-baa9-886420f8be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.003668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac842f9-4458-4db0-baa9-886420f8be23 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.004220 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac842f9-4458-4db0-baa9-886420f8be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.004750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac842f9-4458-4db0-baa9-886420f8be23 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.006362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac842f9-4458-4db0-baa9-886420f8be23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.011869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac842f9-4458-4db0-baa9-886420f8be23 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.042526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 952/1901] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:03.046741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e77fe0-5303-4814-9981-aabcff1ea0c3 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.161697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e77fe0-5303-4814-9981-aabcff1ea0c3 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.179501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28077c07-c235-4ac2-b8d7-30d3007546e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.180804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28077c07-c235-4ac2-b8d7-30d3007546e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.181101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28077c07-c235-4ac2-b8d7-30d3007546e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.181382 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28077c07-c235-4ac2-b8d7-30d3007546e8 admin admin] PATH_INFO: `/v3/projects/d6254bf7ad8e472ba96e7deb7af1df4f/users/09e19195b2d34f038fbf1e7cf094935d/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.184092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28077c07-c235-4ac2-b8d7-30d3007546e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6254bf7ad8e472ba96e7deb7af1df4f, user_id=09e19195b2d34f038fbf1e7cf094935d, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.187694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28077c07-c235-4ac2-b8d7-30d3007546e8 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.195203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:03.211326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 950/1902] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:03 2022] PUT /identity/v3/projects/d6254bf7ad8e472ba96e7deb7af1df4f/users/09e19195b2d34f038fbf1e7cf094935d/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:03.213088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6d96-e99d-4d30-b6e8-a0db09bfebce None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.213918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6d96-e99d-4d30-b6e8-a0db09bfebce None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.214247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6d96-e99d-4d30-b6e8-a0db09bfebce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.252022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-97bc6d96-e99d-4d30-b6e8-a0db09bfebce None None] MFA Rules not processed for user `09e19195b2d34f038fbf1e7cf094935d`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:03.255198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-97bc6d96-e99d-4d30-b6e8-a0db09bfebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:03.374378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 953/1903] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:03.547943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28077c07-c235-4ac2-b8d7-30d3007546e8 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.717719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28077c07-c235-4ac2-b8d7-30d3007546e8 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.732368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaab80-685b-4490-9fbe-6bb328e0328a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.733170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaab80-685b-4490-9fbe-6bb328e0328a service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.733669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaab80-685b-4490-9fbe-6bb328e0328a service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.734704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaab80-685b-4490-9fbe-6bb328e0328a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.752648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaab80-685b-4490-9fbe-6bb328e0328a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.755491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaab80-685b-4490-9fbe-6bb328e0328a service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.772076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 951/1904] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:11.667485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6d96-e99d-4d30-b6e8-a0db09bfebce None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:11.690844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:11.835603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6d96-e99d-4d30-b6e8-a0db09bfebce None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:11.846880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:11.847807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:11.848096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:11.848411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] PATH_INFO: `/v3/users/81bf33dbc1694b218d8c51272a22119d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:11.852306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bf33dbc1694b218d8c51272a22119d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:11.857104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:12.079116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bf33dbc1694b218d8c51272a22119d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:12.158672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bf33dbc1694b218d8c51272a22119d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:12.182041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bf33dbc1694b218d8c51272a22119d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:12.216188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bf33dbc1694b218d8c51272a22119d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:12.225229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bf33dbc1694b218d8c51272a22119d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:12.255420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 954/1905] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:11 2022] DELETE /identity/v3/users/81bf33dbc1694b218d8c51272a22119d => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:12.261550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058d6d-8cdc-42cb-9ae4-f7dc1fc7036d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:12.262134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058d6d-8cdc-42cb-9ae4-f7dc1fc7036d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:12.263857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058d6d-8cdc-42cb-9ae4-f7dc1fc7036d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:12.306386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-85058d6d-8cdc-42cb-9ae4-f7dc1fc7036d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:12.310458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-85058d6d-8cdc-42cb-9ae4-f7dc1fc7036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:12.431801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 952/1906] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:12.460029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:12.462490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:12.584708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9897-7c51-4b76-8902-61d3f87458af admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:12.603858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:12.605086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:12.605598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:12.606058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:12.624021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:12.627440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:12.666794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 955/1907] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:12.716169 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85058d6d-8cdc-42cb-9ae4-f7dc1fc7036d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:12.720204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-85058d6d-8cdc-42cb-9ae4-f7dc1fc7036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:12.761607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85058d6d-8cdc-42cb-9ae4-f7dc1fc7036d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:12.770267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:12.772410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:12.772774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:12.773129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:12.780023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:12.998264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:13.000089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:13.058318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 953/1908] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:14.688480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:14.690678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:14.713575 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6d4c4-a2fe-4bd2-aafc-b461896f374e service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:14.720735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:14.721988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:14.722532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:14.723032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] PATH_INFO: `/v3/projects/44a241ef87f643d186ba4d699a0c302c` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:14.725419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a241ef87f643d186ba4d699a0c302c)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:14.728332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:14.904038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:14.935837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a241ef87f643d186ba4d699a0c302c', 'request_id': 'req-0a783776-11e6-40ca-8c2c-9840bd512b1c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:14.998065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a241ef87f643d186ba4d699a0c302c', 'request_id': 'req-0a783776-11e6-40ca-8c2c-9840bd512b1c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.007337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a241ef87f643d186ba4d699a0c302c', 'request_id': 'req-0a783776-11e6-40ca-8c2c-9840bd512b1c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.033610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] The token cache is being invalidate because project 44a241ef87f643d186ba4d699a0c302c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:15.034055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.036568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.050875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:15.053183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 956/1909] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:14 2022] DELETE /identity/v3/projects/44a241ef87f643d186ba4d699a0c302c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:15.063910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc90-dc2d-43e2-ac46-2af9f2a9b342 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:15.136893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:15.193618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:15.194885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:15.195458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:15.196132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] PATH_INFO: `/v3/users/09e19195b2d34f038fbf1e7cf094935d` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:15.197748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e19195b2d34f038fbf1e7cf094935d)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:15.207001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:15.461767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e19195b2d34f038fbf1e7cf094935d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.559486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e19195b2d34f038fbf1e7cf094935d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.604513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e19195b2d34f038fbf1e7cf094935d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.605370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e19195b2d34f038fbf1e7cf094935d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.628454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-2b64430c-774f-4468-88a6-83af3c627c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e19195b2d34f038fbf1e7cf094935d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.645316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 954/1910] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:15 2022] DELETE /identity/v3/users/09e19195b2d34f038fbf1e7cf094935d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:16.730645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:16.733746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:16.777250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a783776-11e6-40ca-8c2c-9840bd512b1c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:16.927720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:16.928654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:16.928925 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:16.929215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] PATH_INFO: `/v3/projects/d6254bf7ad8e472ba96e7deb7af1df4f` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:16.930589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6254bf7ad8e472ba96e7deb7af1df4f)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:16.943752 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:17.107190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6254bf7ad8e472ba96e7deb7af1df4f', 'request_id': 'req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:17.208421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6254bf7ad8e472ba96e7deb7af1df4f', 'request_id': 'req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:17.225617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6254bf7ad8e472ba96e7deb7af1df4f', 'request_id': 'req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:17.255541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] The token cache is being invalidate because project d6254bf7ad8e472ba96e7deb7af1df4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:17.273487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:17.273681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7fea0f16-ab99-4f8b-9bd7-78e0cf80a293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:17.280214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 957/1911] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:16 2022] DELETE /identity/v3/projects/d6254bf7ad8e472ba96e7deb7af1df4f => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:17.285162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61198f-7b54-48af-a4c5-d71ea9ed896d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:17.286138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61198f-7b54-48af-a4c5-d71ea9ed896d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:17.286714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61198f-7b54-48af-a4c5-d71ea9ed896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:17.325138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1b61198f-7b54-48af-a4c5-d71ea9ed896d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:17.330710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1b61198f-7b54-48af-a4c5-d71ea9ed896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:17.501463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 955/1912] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:17.504168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52649-ee1e-43f5-9680-be23be939293 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:17.504883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52649-ee1e-43f5-9680-be23be939293 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:17.504883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52649-ee1e-43f5-9680-be23be939293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:17.541021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-eab52649-ee1e-43f5-9680-be23be939293 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:17.542998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-eab52649-ee1e-43f5-9680-be23be939293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:17.554289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 958/1913] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:17.561071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61198f-7b54-48af-a4c5-d71ea9ed896d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:17.580449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61198f-7b54-48af-a4c5-d71ea9ed896d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:17.604843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:17.606202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:17.607266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:17.607726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:17.608783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:17.615625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:17.615625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:17.637206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 956/1914] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:17.642294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab52649-ee1e-43f5-9680-be23be939293 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:17.674281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab52649-ee1e-43f5-9680-be23be939293 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:17.683491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079c05e-02ce-49bb-acd9-da87019f0490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:17.684375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079c05e-02ce-49bb-acd9-da87019f0490 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:17.684820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079c05e-02ce-49bb-acd9-da87019f0490 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:17.685786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079c05e-02ce-49bb-acd9-da87019f0490 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:17.687245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079c05e-02ce-49bb-acd9-da87019f0490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:17.690966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079c05e-02ce-49bb-acd9-da87019f0490 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:17.835428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 959/1915] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:17 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:54:17.839497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:17.853553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649eb0d-3bd3-4fa8-a8c6-9d7f1adc2bb2 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:17.945007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:17.990657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c4316-16ae-44f0-b95a-014da8c3df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:17.991677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c4316-16ae-44f0-b95a-014da8c3df0c admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:17.992131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c4316-16ae-44f0-b95a-014da8c3df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:17.992664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c4316-16ae-44f0-b95a-014da8c3df0c admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:17.993792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c4316-16ae-44f0-b95a-014da8c3df0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:17.997185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c4316-16ae-44f0-b95a-014da8c3df0c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:18.141787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 957/1916] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:17 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:54:18.147361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079c05e-02ce-49bb-acd9-da87019f0490 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:18.162727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079c05e-02ce-49bb-acd9-da87019f0490 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:18.175366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:18.176474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:18.176976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:18.178797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:18.179935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:18.184973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:18.219719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 960/1917] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:18.221857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c4316-16ae-44f0-b95a-014da8c3df0c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:18.238605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c4316-16ae-44f0-b95a-014da8c3df0c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:18.253701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bc889-b6f3-48b2-9308-f5c34fc99bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:18.254430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc889-b6f3-48b2-9308-f5c34fc99bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:18.254700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc889-b6f3-48b2-9308-f5c34fc99bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:18.254977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc889-b6f3-48b2-9308-f5c34fc99bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:18.256625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bc889-b6f3-48b2-9308-f5c34fc99bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:18.257896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bc889-b6f3-48b2-9308-f5c34fc99bd5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:18.267361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:18.269964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:18.281905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 958/1918] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:18.287625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bc889-b6f3-48b2-9308-f5c34fc99bd5 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:18.296643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:18.322427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bc889-b6f3-48b2-9308-f5c34fc99bd5 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:18.336700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b622-822f-435e-8a3d-b78b7bd98c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:18.337630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b622-822f-435e-8a3d-b78b7bd98c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:18.337913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b622-822f-435e-8a3d-b78b7bd98c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:18.338209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b622-822f-435e-8a3d-b78b7bd98c74 admin admin] PATH_INFO: `/v3/projects/58b68ec62c50448e959c91d86ec2e487/users/adfc1008b8da4949a8c8c9343cfd2ea9/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:18.365879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20b622-822f-435e-8a3d-b78b7bd98c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b68ec62c50448e959c91d86ec2e487, user_id=adfc1008b8da4949a8c8c9343cfd2ea9, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:18.368800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20b622-822f-435e-8a3d-b78b7bd98c74 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:18.426478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e803e4c-bd86-4568-aaa3-2a2c911c4a9b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:18.436987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3c7449b7b44ee193d8ef27c3f9a1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029ef5a6bee9445ca13638f5de2d90bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:18.438066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:18.438513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:18.440344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:18.441959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:18.442751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:18.446763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:18.452135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 959/1919] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:18 2022] PUT /identity/v3/projects/58b68ec62c50448e959c91d86ec2e487/users/adfc1008b8da4949a8c8c9343cfd2ea9/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:18.464478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7927d5-7c5c-4835-9f2a-abc064d7fea8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:18.464772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7927d5-7c5c-4835-9f2a-abc064d7fea8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:18.465054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7927d5-7c5c-4835-9f2a-abc064d7fea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:18.481413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 961/1920] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:18.495746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:18.517204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704156-0497-4224-bfd7-45b5541fd154 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:18.528651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-5e7927d5-7c5c-4835-9f2a-abc064d7fea8 None None] MFA Rules not processed for user `adfc1008b8da4949a8c8c9343cfd2ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:18.540294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5e7927d5-7c5c-4835-9f2a-abc064d7fea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:18.618664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fbe47-1ad2-492a-8c16-70605d1f8602 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3c7449b7b44ee193d8ef27c3f9a1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029ef5a6bee9445ca13638f5de2d90bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:18.619700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbe47-1ad2-492a-8c16-70605d1f8602 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:18.620103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbe47-1ad2-492a-8c16-70605d1f8602 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:18.620490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbe47-1ad2-492a-8c16-70605d1f8602 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:18.621362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fbe47-1ad2-492a-8c16-70605d1f8602 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:18.624727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fbe47-1ad2-492a-8c16-70605d1f8602 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:18.676063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 960/1921] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:18.714469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7927d5-7c5c-4835-9f2a-abc064d7fea8 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:18.716492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 962/1922] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:18 2022] POST /identity/v3/projects => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:54:18.719419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fbe47-1ad2-492a-8c16-70605d1f8602 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:18.722084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5e7927d5-7c5c-4835-9f2a-abc064d7fea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:18.843111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7927d5-7c5c-4835-9f2a-abc064d7fea8 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:18.885300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fbe47-1ad2-492a-8c16-70605d1f8602 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:18.900221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3c7449b7b44ee193d8ef27c3f9a1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029ef5a6bee9445ca13638f5de2d90bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:18.900919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:18.901211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:18.901495 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:18.902289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:18.902607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:18.905204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:18.914996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:18.928521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:18.929412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:18.930017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:18.930450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:18.934017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 963/1923] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:19.021530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:19.024285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:19.040042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 961/1924] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:20.204681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:20.225583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297383-bb52-48d9-a67d-3b4d6e19ad87 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:20.239739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3c7449b7b44ee193d8ef27c3f9a1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029ef5a6bee9445ca13638f5de2d90bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:20.247264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:20.247990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:20.249224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] PATH_INFO: `/v3/projects/5a0404e5f19f49f9b730ccd2830d79ed` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:20.252464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a0404e5f19f49f9b730ccd2830d79ed)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:20.260599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:20.304441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:20.484757 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0404e5f19f49f9b730ccd2830d79ed', 'request_id': 'req-0ed3556a-9233-487b-a021-b7334b10c302'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:20.621186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0404e5f19f49f9b730ccd2830d79ed', 'request_id': 'req-0ed3556a-9233-487b-a021-b7334b10c302'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:20.635699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0404e5f19f49f9b730ccd2830d79ed', 'request_id': 'req-0ed3556a-9233-487b-a021-b7334b10c302'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:20.661185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] The token cache is being invalidate because project 5a0404e5f19f49f9b730ccd2830d79ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:20.663663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:20.665039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:20.674694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 964/1925] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:20 2022] DELETE /identity/v3/projects/5a0404e5f19f49f9b730ccd2830d79ed => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:20.691558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:20.692231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:20.704602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854a70-d58d-4b69-937a-4734e39efa3b service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:20.765138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caf47b-7f35-446c-ae67-278b9ba62d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:20.765814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf47b-7f35-446c-ae67-278b9ba62d8a service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:20.766116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf47b-7f35-446c-ae67-278b9ba62d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:20.766431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf47b-7f35-446c-ae67-278b9ba62d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:20.768447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b1caf47b-7f35-446c-ae67-278b9ba62d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:20.841513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caf47b-7f35-446c-ae67-278b9ba62d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:20.843108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caf47b-7f35-446c-ae67-278b9ba62d8a service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:20.854184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 962/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:54:24.095107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:24.096640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:24.296454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3556a-9233-487b-a021-b7334b10c302 tempest-RoutersAdminTest-1976591016 tempest-RoutersAdminTest-1976591016-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:24.310508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:24.311522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:24.311921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:24.312286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] PATH_INFO: `/v3/users/62c293b965474e4a8331ed615914c9eb` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:24.313873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c293b965474e4a8331ed615914c9eb)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:24.316680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:24.578388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c293b965474e4a8331ed615914c9eb'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:24.672864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c293b965474e4a8331ed615914c9eb'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:24.717604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c293b965474e4a8331ed615914c9eb'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:24.734146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c293b965474e4a8331ed615914c9eb'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:24.764729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c293b965474e4a8331ed615914c9eb'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:24.789539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 965/1927] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:24 2022] DELETE /identity/v3/users/62c293b965474e4a8331ed615914c9eb => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:24.791460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d77a5-9b33-43f1-a44d-59a1c007c57d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:24.792378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d77a5-9b33-43f1-a44d-59a1c007c57d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:24.792813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d77a5-9b33-43f1-a44d-59a1c007c57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:24.827424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-715d77a5-9b33-43f1-a44d-59a1c007c57d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:24.831443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-715d77a5-9b33-43f1-a44d-59a1c007c57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:24.879083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:24.881681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:24.940911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:24.964661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:25.000532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 963/1928] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:25.034475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d77a5-9b33-43f1-a44d-59a1c007c57d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:25.036170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-715d77a5-9b33-43f1-a44d-59a1c007c57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:25.042807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466072b-91fa-4b9d-8589-7b7cd2c70978 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:25.051221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:25.052132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:25.052954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:25.053291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] PATH_INFO: `/v3/users/d9bfef842672407c992c59ca51329f53` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:25.055091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bfef842672407c992c59ca51329f53)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:25.060977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:25.162660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d77a5-9b33-43f1-a44d-59a1c007c57d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:25.167435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e60d93-9635-4b51-8475-4f2719c8d149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:25.170849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60d93-9635-4b51-8475-4f2719c8d149 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:25.170849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60d93-9635-4b51-8475-4f2719c8d149 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:25.171162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60d93-9635-4b51-8475-4f2719c8d149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:25.186073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e60d93-9635-4b51-8475-4f2719c8d149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:25.187825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e60d93-9635-4b51-8475-4f2719c8d149 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:25.208910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 964/1929] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:25.319994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bfef842672407c992c59ca51329f53'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:25.444662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bfef842672407c992c59ca51329f53'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:25.468079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bfef842672407c992c59ca51329f53'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:25.483247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bfef842672407c992c59ca51329f53'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:25.484628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bfef842672407c992c59ca51329f53'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:25.493590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 966/1930] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:24 2022] DELETE /identity/v3/users/d9bfef842672407c992c59ca51329f53 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:25.499023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e016c-57ba-4f1c-80e2-9225fdd9188d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:25.499713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e016c-57ba-4f1c-80e2-9225fdd9188d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:25.500116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e016c-57ba-4f1c-80e2-9225fdd9188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:25.525176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-fd9e016c-57ba-4f1c-80e2-9225fdd9188d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:25.526701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-fd9e016c-57ba-4f1c-80e2-9225fdd9188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:25.668524 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 965/1931] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:25.680371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:25.682307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:25.780004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde6ec-14fc-468d-b811-1fc53ef17919 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:25.784988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:25.791506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:25.791506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:25.791506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:25.812904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:25.814668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:25.827601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 967/1932] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:26.160774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e016c-57ba-4f1c-80e2-9225fdd9188d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:26.162954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-fd9e016c-57ba-4f1c-80e2-9225fdd9188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:26.199322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e016c-57ba-4f1c-80e2-9225fdd9188d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:26.213297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:26.216351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:26.216706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:26.217050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] PATH_INFO: `/v3/projects/0bdaa53ac4ca44d9a4d1016f748c9892` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:26.218687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdaa53ac4ca44d9a4d1016f748c9892)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:26.221481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:26.394852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdaa53ac4ca44d9a4d1016f748c9892', 'request_id': 'req-0a3e3ca1-a52c-4083-ba77-651032ba7571'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.432545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:26.434000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:26.455647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17b38-4739-4d2e-9e6e-8b50332fc4a0 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:26.466681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdaa53ac4ca44d9a4d1016f748c9892', 'request_id': 'req-0a3e3ca1-a52c-4083-ba77-651032ba7571'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.477188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdaa53ac4ca44d9a4d1016f748c9892', 'request_id': 'req-0a3e3ca1-a52c-4083-ba77-651032ba7571'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.514841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] The token cache is being invalidate because project 0bdaa53ac4ca44d9a4d1016f748c9892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:26.515137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.515816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.520660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 966/1933] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:26 2022] DELETE /identity/v3/projects/0bdaa53ac4ca44d9a4d1016f748c9892 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:26.521894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:26.523420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:26.558550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:26.576839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:26.614214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:26.616276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:26.616932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:26.617297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] PATH_INFO: `/v3/projects/429fff1afce148ada441f9b993837865` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:26.620229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=429fff1afce148ada441f9b993837865)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:26.622955 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:26.672942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e3ca1-a52c-4083-ba77-651032ba7571 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:26.686412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:26.686787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:26.687080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:26.687364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] PATH_INFO: `/v3/users/5d6819b15a1740bd9bf8fb0730f5e44a` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:26.690289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6819b15a1740bd9bf8fb0730f5e44a)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:26.696522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:26.790575 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429fff1afce148ada441f9b993837865', 'request_id': 'req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.879715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429fff1afce148ada441f9b993837865', 'request_id': 'req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.899525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429fff1afce148ada441f9b993837865', 'request_id': 'req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.920078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] The token cache is being invalidate because project 429fff1afce148ada441f9b993837865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:26.921870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.922882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:26.928705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 968/1934] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:26 2022] DELETE /identity/v3/projects/429fff1afce148ada441f9b993837865 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:26.930450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:26.931902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:27.031591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6819b15a1740bd9bf8fb0730f5e44a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.089152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60b81-a007-4a64-b8e5-a600dc8a8c3f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:27.096622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:27.098688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:27.099024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:27.099851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] PATH_INFO: `/v3/users/ab4632ec4563463a8125ae502972a654` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:27.101461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4632ec4563463a8125ae502972a654)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:27.105401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:27.119127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6819b15a1740bd9bf8fb0730f5e44a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.143304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6819b15a1740bd9bf8fb0730f5e44a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.144082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6819b15a1740bd9bf8fb0730f5e44a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.162689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6819b15a1740bd9bf8fb0730f5e44a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.174303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 967/1935] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:26 2022] DELETE /identity/v3/users/5d6819b15a1740bd9bf8fb0730f5e44a => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:27.355566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4632ec4563463a8125ae502972a654'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.478995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4632ec4563463a8125ae502972a654'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.524802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4632ec4563463a8125ae502972a654'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.540226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4632ec4563463a8125ae502972a654'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.541351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-79802785-8002-4a47-b58f-f38fdafccf59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4632ec4563463a8125ae502972a654'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:27.558031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 969/1936] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:26 2022] DELETE /identity/v3/users/ab4632ec4563463a8125ae502972a654 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:27.709754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:27.714758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:27.855515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:27.926722 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a07bc-4a08-4f59-8d3d-04737136de21 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:28.028869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:28.073019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:28.073993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:28.074421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:28.074797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] PATH_INFO: `/v3/projects/a0713024fb3a4744bd4935be61054dee` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:28.076252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0713024fb3a4744bd4935be61054dee)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:28.079555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:28.251391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0713024fb3a4744bd4935be61054dee', 'request_id': 'req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.322141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0713024fb3a4744bd4935be61054dee', 'request_id': 'req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.348410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0713024fb3a4744bd4935be61054dee', 'request_id': 'req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.376870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] The token cache is being invalidate because project a0713024fb3a4744bd4935be61054dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:28.377460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.378977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.386462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c885-3e8b-4f0e-8a14-be90caded651 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:28.386992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c885-3e8b-4f0e-8a14-be90caded651 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:28.387490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c885-3e8b-4f0e-8a14-be90caded651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:28.390397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 968/1937] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:27 2022] DELETE /identity/v3/projects/a0713024fb3a4744bd4935be61054dee => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:28.424351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1088c885-3e8b-4f0e-8a14-be90caded651 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:28.425661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1088c885-3e8b-4f0e-8a14-be90caded651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:28.528508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:28.530899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:28.597158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 970/1938] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:28.601692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be589-5f36-4831-a8f2-d7005c53dd69 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:28.603371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be589-5f36-4831-a8f2-d7005c53dd69 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:28.605479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be589-5f36-4831-a8f2-d7005c53dd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:28.651587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-219be589-5f36-4831-a8f2-d7005c53dd69 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:28.652881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-219be589-5f36-4831-a8f2-d7005c53dd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:28.669610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 971/1939] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:28.677164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219be589-5f36-4831-a8f2-d7005c53dd69 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:28.690303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219be589-5f36-4831-a8f2-d7005c53dd69 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:28.705108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:28.705812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:28.706296 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:28.706724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:28.713266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:28.713266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:28.713266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:28.716000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d2b14-7e55-4b69-b0a6-bc471aa52af4 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:28.723426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:28.728182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:28.728182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:28.728182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] PATH_INFO: `/v3/projects/4c3fb877a65f49a4b82c54eae78cd420` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:28.734132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3fb877a65f49a4b82c54eae78cd420)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:28.736259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:28.744137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 972/1940] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:28.751506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:28.770362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75670-487c-4649-b4a7-e3f72bf76b67 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:28.776536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c5c3-ba27-4a11-b077-11edccdb3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:28.777231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c5c3-ba27-4a11-b077-11edccdb3cae admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:28.777518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c5c3-ba27-4a11-b077-11edccdb3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:28.777799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c5c3-ba27-4a11-b077-11edccdb3cae admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:28.779155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c5c3-ba27-4a11-b077-11edccdb3cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:28.781127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c5c3-ba27-4a11-b077-11edccdb3cae admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:28.908814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 973/1941] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:28 2022] POST /identity/v3/projects => generated 355 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:28.912834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c5c3-ba27-4a11-b077-11edccdb3cae admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:28.923904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3fb877a65f49a4b82c54eae78cd420', 'request_id': 'req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.010390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3fb877a65f49a4b82c54eae78cd420', 'request_id': 'req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.020357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3fb877a65f49a4b82c54eae78cd420', 'request_id': 'req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.042731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] The token cache is being invalidate because project 4c3fb877a65f49a4b82c54eae78cd420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:29.046030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.047150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-950afc5a-abd9-4fe4-beae-f8ee2828d3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.049095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c5c3-ba27-4a11-b077-11edccdb3cae admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.050257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 969/1942] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:28 2022] DELETE /identity/v3/projects/4c3fb877a65f49a4b82c54eae78cd420 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:29.055864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.057587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cca9b-e07a-4eba-821b-8ed6ef8f55e3 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.057587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cca9b-e07a-4eba-821b-8ed6ef8f55e3 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.057787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.058006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.058258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cca9b-e07a-4eba-821b-8ed6ef8f55e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.059224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.059957 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.066991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.104002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-101cca9b-e07a-4eba-821b-8ed6ef8f55e3 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:29.105590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-101cca9b-e07a-4eba-821b-8ed6ef8f55e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:29.114968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 970/1943] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:29.123226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c21cd-b206-4ab2-a1b5-bebec96a7245 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.123664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c21cd-b206-4ab2-a1b5-bebec96a7245 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.124038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c21cd-b206-4ab2-a1b5-bebec96a7245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.148228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-320c21cd-b206-4ab2-a1b5-bebec96a7245 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:29.149817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-320c21cd-b206-4ab2-a1b5-bebec96a7245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:29.163547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 971/1944] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:29.178656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 974/1945] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:28 2022] POST /identity/v3/users => generated 278 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:54:29.179602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c21cd-b206-4ab2-a1b5-bebec96a7245 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.187396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.189323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:29.205422 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c21cd-b206-4ab2-a1b5-bebec96a7245 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.212120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dab11-fcd7-45a3-b176-2afc9108cc39 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.218196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.219589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.220428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.221213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.223654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:29.224271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.226004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8300c4-7204-404c-8d8a-75c8e0ffbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.227749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8300c4-7204-404c-8d8a-75c8e0ffbf35 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.228623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.228996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8300c4-7204-404c-8d8a-75c8e0ffbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.229347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8300c4-7204-404c-8d8a-75c8e0ffbf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.230378 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8300c4-7204-404c-8d8a-75c8e0ffbf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.235954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8300c4-7204-404c-8d8a-75c8e0ffbf35 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.261910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 972/1946] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:29.269104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.272015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 975/1947] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:54:29.275056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8300c4-7204-404c-8d8a-75c8e0ffbf35 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.291756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6f82-38a1-4441-b04d-a9f577c00fe6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.299621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5d46-f428-46d8-8c14-6df89537f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.300661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5d46-f428-46d8-8c14-6df89537f034 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.301101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5d46-f428-46d8-8c14-6df89537f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.301527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5d46-f428-46d8-8c14-6df89537f034 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.303093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5d46-f428-46d8-8c14-6df89537f034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.305564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5d46-f428-46d8-8c14-6df89537f034 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.307362 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8300c4-7204-404c-8d8a-75c8e0ffbf35 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.322871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b78cd-dbf2-484e-8a9d-b192ffbd62fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.323745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b78cd-dbf2-484e-8a9d-b192ffbd62fc admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.329361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b78cd-dbf2-484e-8a9d-b192ffbd62fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.329361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b78cd-dbf2-484e-8a9d-b192ffbd62fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.329361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b78cd-dbf2-484e-8a9d-b192ffbd62fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.330243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b78cd-dbf2-484e-8a9d-b192ffbd62fc admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.351493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:29.363594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 976/1948] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:29.375510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b78cd-dbf2-484e-8a9d-b192ffbd62fc admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.405021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b78cd-dbf2-484e-8a9d-b192ffbd62fc admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.433015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 973/1949] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:29.439626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69bad9-94f1-4a25-b758-a30a10c0c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.440691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69bad9-94f1-4a25-b758-a30a10c0c03c admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.440986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69bad9-94f1-4a25-b758-a30a10c0c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.441188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5d46-f428-46d8-8c14-6df89537f034 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.441325 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69bad9-94f1-4a25-b758-a30a10c0c03c admin admin] PATH_INFO: `/v3/projects/d94ae26aa1184195830c0f7a919f71a7/users/9d6cfdf5d4774d0db798a5ff3dfcc12f/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.482298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69bad9-94f1-4a25-b758-a30a10c0c03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94ae26aa1184195830c0f7a919f71a7, user_id=9d6cfdf5d4774d0db798a5ff3dfcc12f, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.484753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69bad9-94f1-4a25-b758-a30a10c0c03c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.494670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:29.547687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 977/1950] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:29 2022] PUT /identity/v3/projects/d94ae26aa1184195830c0f7a919f71a7/users/9d6cfdf5d4774d0db798a5ff3dfcc12f/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:29.560243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e036a-818e-419a-8229-bab493614596 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.560533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e036a-818e-419a-8229-bab493614596 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.561122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e036a-818e-419a-8229-bab493614596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.631874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5d46-f428-46d8-8c14-6df89537f034 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.632940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-685e036a-818e-419a-8229-bab493614596 None None] MFA Rules not processed for user `9d6cfdf5d4774d0db798a5ff3dfcc12f`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:29.634271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-685e036a-818e-419a-8229-bab493614596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:29.740926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd000-f3b3-4a25-a314-3f37a08cf2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.741626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd000-f3b3-4a25-a314-3f37a08cf2ce admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.741920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd000-f3b3-4a25-a314-3f37a08cf2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.742295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd000-f3b3-4a25-a314-3f37a08cf2ce admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.744268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd000-f3b3-4a25-a314-3f37a08cf2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.746827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd000-f3b3-4a25-a314-3f37a08cf2ce admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.831899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 978/1951] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:29.837655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e036a-818e-419a-8229-bab493614596 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.864090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 974/1952] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/users => generated 285 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:29.866390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd000-f3b3-4a25-a314-3f37a08cf2ce admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.881057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e036a-818e-419a-8229-bab493614596 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.893418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd000-f3b3-4a25-a314-3f37a08cf2ce admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.904487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a38ef6-501a-4211-8f01-75c115e14885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.905344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38ef6-501a-4211-8f01-75c115e14885 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.906269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38ef6-501a-4211-8f01-75c115e14885 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.907146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38ef6-501a-4211-8f01-75c115e14885 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.908438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a38ef6-501a-4211-8f01-75c115e14885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.912893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a38ef6-501a-4211-8f01-75c115e14885 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.918509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb931b5a-eacc-4038-947e-447c2ab613d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.918509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931b5a-eacc-4038-947e-447c2ab613d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.918509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931b5a-eacc-4038-947e-447c2ab613d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.918509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931b5a-eacc-4038-947e-447c2ab613d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.922187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb931b5a-eacc-4038-947e-447c2ab613d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.927782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb931b5a-eacc-4038-947e-447c2ab613d3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.954226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 975/1953] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:29.957081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb931b5a-eacc-4038-947e-447c2ab613d3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.970129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb931b5a-eacc-4038-947e-447c2ab613d3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.977568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e028b64-6da6-4b25-b166-092316481f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.978566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028b64-6da6-4b25-b166-092316481f8d admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.978999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028b64-6da6-4b25-b166-092316481f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.979442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028b64-6da6-4b25-b166-092316481f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.980377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e028b64-6da6-4b25-b166-092316481f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.982335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e028b64-6da6-4b25-b166-092316481f8d admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.002788 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 976/1954] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:30.006863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e028b64-6da6-4b25-b166-092316481f8d admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.024710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e028b64-6da6-4b25-b166-092316481f8d admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.034043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 979/1955] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/projects => generated 357 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:30.037665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a38ef6-501a-4211-8f01-75c115e14885 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.052449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdc195-4e1a-421d-960b-fd3fdff23928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.053719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdc195-4e1a-421d-960b-fd3fdff23928 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.054017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdc195-4e1a-421d-960b-fd3fdff23928 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.054337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdc195-4e1a-421d-960b-fd3fdff23928 admin admin] PATH_INFO: `/v3/projects/a07710250cad426387e95348a8bd7d48/users/e2a7ae02fcca49c7be9cd21813cfb985/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.112561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdc195-4e1a-421d-960b-fd3fdff23928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07710250cad426387e95348a8bd7d48, user_id=e2a7ae02fcca49c7be9cd21813cfb985, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.114756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdc195-4e1a-421d-960b-fd3fdff23928 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.197317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a38ef6-501a-4211-8f01-75c115e14885 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.204097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787c1d2-4bc5-41d3-a8cf-630745d6b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.206234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787c1d2-4bc5-41d3-a8cf-630745d6b854 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.206578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787c1d2-4bc5-41d3-a8cf-630745d6b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.206839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787c1d2-4bc5-41d3-a8cf-630745d6b854 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.207566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787c1d2-4bc5-41d3-a8cf-630745d6b854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.210966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787c1d2-4bc5-41d3-a8cf-630745d6b854 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.231038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 977/1956] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:30 2022] PUT /identity/v3/projects/a07710250cad426387e95348a8bd7d48/users/e2a7ae02fcca49c7be9cd21813cfb985/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:30.242727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70fad8-b294-407a-ad03-04d42a3d6122 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.243043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70fad8-b294-407a-ad03-04d42a3d6122 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.243344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70fad8-b294-407a-ad03-04d42a3d6122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.289100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4a70fad8-b294-407a-ad03-04d42a3d6122 None None] MFA Rules not processed for user `e2a7ae02fcca49c7be9cd21813cfb985`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:30.290852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4a70fad8-b294-407a-ad03-04d42a3d6122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:30.393369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 980/1957] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:30 2022] POST /identity/v3/users => generated 285 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:30.404576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787c1d2-4bc5-41d3-a8cf-630745d6b854 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.415705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787c1d2-4bc5-41d3-a8cf-630745d6b854 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.454935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 978/1958] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:30.466869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70fad8-b294-407a-ad03-04d42a3d6122 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.468389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4a70fad8-b294-407a-ad03-04d42a3d6122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:30.525465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ca175-65bd-4d55-bca7-534210834971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.526499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ca175-65bd-4d55-bca7-534210834971 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.527105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ca175-65bd-4d55-bca7-534210834971 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.527605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ca175-65bd-4d55-bca7-534210834971 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.529072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ca175-65bd-4d55-bca7-534210834971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.531563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ca175-65bd-4d55-bca7-534210834971 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.545647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 981/1959] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:30.550735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ca175-65bd-4d55-bca7-534210834971 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.564337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:30.573463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ca175-65bd-4d55-bca7-534210834971 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.575684 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70fad8-b294-407a-ad03-04d42a3d6122 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.586124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224105-5510-49f1-9924-73b1b0438d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.586483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02fac1-0bdb-4325-9515-ec56995c6663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.587438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02fac1-0bdb-4325-9515-ec56995c6663 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.588074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224105-5510-49f1-9924-73b1b0438d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.588584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224105-5510-49f1-9924-73b1b0438d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.589398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02fac1-0bdb-4325-9515-ec56995c6663 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.590276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02fac1-0bdb-4325-9515-ec56995c6663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.590602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224105-5510-49f1-9924-73b1b0438d5a admin admin] PATH_INFO: `/v3/projects/e52212f65a57433ba626240dde67d7e4/users/181cf7d511b449b490e46ac32e363915/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.613347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02fac1-0bdb-4325-9515-ec56995c6663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.617545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02fac1-0bdb-4325-9515-ec56995c6663 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.629368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224105-5510-49f1-9924-73b1b0438d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52212f65a57433ba626240dde67d7e4, user_id=181cf7d511b449b490e46ac32e363915, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.634787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224105-5510-49f1-9924-73b1b0438d5a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.649929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 979/1960] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:54:30.702237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:30.739594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 982/1961] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:30 2022] PUT /identity/v3/projects/e52212f65a57433ba626240dde67d7e4/users/181cf7d511b449b490e46ac32e363915/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:30.743534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02fac1-0bdb-4325-9515-ec56995c6663 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.763759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02fac1-0bdb-4325-9515-ec56995c6663 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:31.005951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a923d-d116-4803-8bb9-71781b9d4471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:31.007122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a923d-d116-4803-8bb9-71781b9d4471 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:31.013025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a923d-d116-4803-8bb9-71781b9d4471 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:31.013025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a923d-d116-4803-8bb9-71781b9d4471 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:31.013025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a923d-d116-4803-8bb9-71781b9d4471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:31.013025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a923d-d116-4803-8bb9-71781b9d4471 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:31.040898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 980/1962] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:54:31.045027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224105-5510-49f1-9924-73b1b0438d5a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:31.097076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224105-5510-49f1-9924-73b1b0438d5a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:31.112972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399ec9b-e593-42ab-9af6-6ad2b53ab0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:31.115794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ec9b-e593-42ab-9af6-6ad2b53ab0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:31.116560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ec9b-e593-42ab-9af6-6ad2b53ab0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:31.117244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ec9b-e593-42ab-9af6-6ad2b53ab0d7 admin admin] PATH_INFO: `/v3/projects/e52212f65a57433ba626240dde67d7e4/users/181cf7d511b449b490e46ac32e363915/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:31.119817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399ec9b-e593-42ab-9af6-6ad2b53ab0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52212f65a57433ba626240dde67d7e4, user_id=181cf7d511b449b490e46ac32e363915, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:31.123993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399ec9b-e593-42ab-9af6-6ad2b53ab0d7 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:31.148825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 983/1963] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:31 2022] PUT /identity/v3/projects/e52212f65a57433ba626240dde67d7e4/users/181cf7d511b449b490e46ac32e363915/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:31.160214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ec9c-c9c6-462e-b715-2f0f724b6c3e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:31.160870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ec9c-c9c6-462e-b715-2f0f724b6c3e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:31.161363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ec9c-c9c6-462e-b715-2f0f724b6c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:31.249608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-83f0ec9c-c9c6-462e-b715-2f0f724b6c3e None None] MFA Rules not processed for user `181cf7d511b449b490e46ac32e363915`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:31.251192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-83f0ec9c-c9c6-462e-b715-2f0f724b6c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:31.417315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 981/1964] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:31 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:31.429620 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399ec9b-e593-42ab-9af6-6ad2b53ab0d7 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:31.452730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399ec9b-e593-42ab-9af6-6ad2b53ab0d7 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:31.463196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181cf7d511b449b490e46ac32e363915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52212f65a57433ba626240dde67d7e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:31.464205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:31.467735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:31.468284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:31.469285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:31.469849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:31.475125 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:31.509420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 984/1965] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:31.513366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ec9c-c9c6-462e-b715-2f0f724b6c3e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:31.532707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ec9c-c9c6-462e-b715-2f0f724b6c3e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:31.542142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5728-f4a3-4e7b-9e23-fe6019781ba2 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181cf7d511b449b490e46ac32e363915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52212f65a57433ba626240dde67d7e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:31.543019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5728-f4a3-4e7b-9e23-fe6019781ba2 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:31.543713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5728-f4a3-4e7b-9e23-fe6019781ba2 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:31.544301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5728-f4a3-4e7b-9e23-fe6019781ba2 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:31.545258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5728-f4a3-4e7b-9e23-fe6019781ba2 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:31.548214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5728-f4a3-4e7b-9e23-fe6019781ba2 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:31.735579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 982/1966] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:31 2022] POST /identity/v3/projects => generated 349 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:31.740747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:31.760511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7899df5-cb16-4bfd-8dec-c40b9b79a445 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:31.854006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181cf7d511b449b490e46ac32e363915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52212f65a57433ba626240dde67d7e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:31.854895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:31.855414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:31.856746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:31.858341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:31.859067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:31.861492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:31.884146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 985/1967] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:31.921593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5728-f4a3-4e7b-9e23-fe6019781ba2 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:31.994459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5728-f4a3-4e7b-9e23-fe6019781ba2 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:32.000207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a84399-f060-4cec-8598-138b17ef6176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:32.001152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a84399-f060-4cec-8598-138b17ef6176 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:32.001763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a84399-f060-4cec-8598-138b17ef6176 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:32.002349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a84399-f060-4cec-8598-138b17ef6176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:32.016417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a84399-f060-4cec-8598-138b17ef6176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:32.018842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a84399-f060-4cec-8598-138b17ef6176 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:32.028232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:32.037775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 983/1968] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:31 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:32.442772 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:32.532380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e8654-4454-430f-8c33-407bf4459669 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:32.540900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:32.542068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:32.542621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:32.543102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] PATH_INFO: `/v3/users/e2a7ae02fcca49c7be9cd21813cfb985` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:32.544732 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a7ae02fcca49c7be9cd21813cfb985)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:32.548628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:32.830375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:32.853711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a7ae02fcca49c7be9cd21813cfb985'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:32.928207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a7ae02fcca49c7be9cd21813cfb985'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:32.962333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a7ae02fcca49c7be9cd21813cfb985'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:32.985912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a7ae02fcca49c7be9cd21813cfb985'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:32.987469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a7ae02fcca49c7be9cd21813cfb985'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:33.000306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 986/1969] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:32 2022] DELETE /identity/v3/users/e2a7ae02fcca49c7be9cd21813cfb985 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:33.000784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374abbbe-a28c-405c-9a2d-82eedd8fc0a1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:33.001273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374abbbe-a28c-405c-9a2d-82eedd8fc0a1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:33.001378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374abbbe-a28c-405c-9a2d-82eedd8fc0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:33.036915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-374abbbe-a28c-405c-9a2d-82eedd8fc0a1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:33.038204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-374abbbe-a28c-405c-9a2d-82eedd8fc0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:33.219790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 984/1970] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:33.246798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:33.249141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:33.714692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a0516-4e2a-41fd-a7e0-effcc3818c6d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:33.714692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:33.714692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:33.714692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:33.721543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:33.721543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:33.721543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:33.721543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 987/1971] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:33.759426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374abbbe-a28c-405c-9a2d-82eedd8fc0a1 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:33.761020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-374abbbe-a28c-405c-9a2d-82eedd8fc0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:33.858351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:33.906688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374abbbe-a28c-405c-9a2d-82eedd8fc0a1 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:33.914272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181cf7d511b449b490e46ac32e363915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52212f65a57433ba626240dde67d7e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:33.915453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:33.916051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:33.916506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] PATH_INFO: `/v3/projects/96a96c669ac442729cf7becb8f23195a` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:33.918420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96a96c669ac442729cf7becb8f23195a)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:33.920595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:34.084064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a96c669ac442729cf7becb8f23195a', 'request_id': 'req-ac003f69-1475-4088-824a-70df19b659e0'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:34.221125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a96c669ac442729cf7becb8f23195a', 'request_id': 'req-ac003f69-1475-4088-824a-70df19b659e0'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:34.232644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a96c669ac442729cf7becb8f23195a', 'request_id': 'req-ac003f69-1475-4088-824a-70df19b659e0'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:34.263089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] The token cache is being invalidate because project 96a96c669ac442729cf7becb8f23195a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:34.263744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:34.266414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ac003f69-1475-4088-824a-70df19b659e0 tempest-QuotasTest-1621611291 tempest-QuotasTest-1621611291-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:34.274811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 985/1972] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:33 2022] DELETE /identity/v3/projects/96a96c669ac442729cf7becb8f23195a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:34.766257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:34.774486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:34.799675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012333e-c824-491d-ba2c-da0100307f0e service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:34.878726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:34.879775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:34.880813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:34.881172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] PATH_INFO: `/v3/projects/a07710250cad426387e95348a8bd7d48` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:34.882962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07710250cad426387e95348a8bd7d48)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:34.885058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:35.090295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07710250cad426387e95348a8bd7d48', 'request_id': 'req-2f46b122-bc4f-4055-9f92-e568527dbf0d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:35.181118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07710250cad426387e95348a8bd7d48', 'request_id': 'req-2f46b122-bc4f-4055-9f92-e568527dbf0d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:35.183700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:35.192310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07710250cad426387e95348a8bd7d48', 'request_id': 'req-2f46b122-bc4f-4055-9f92-e568527dbf0d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:35.233635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] The token cache is being invalidate because project a07710250cad426387e95348a8bd7d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:35.234337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:35.235298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f46b122-bc4f-4055-9f92-e568527dbf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:35.240741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 988/1973] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:34 2022] DELETE /identity/v3/projects/a07710250cad426387e95348a8bd7d48 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:35.245849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd70f8-6540-4e5f-949d-429f6a8826d7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:35.246423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd70f8-6540-4e5f-949d-429f6a8826d7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:35.246542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd70f8-6540-4e5f-949d-429f6a8826d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:35.281867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0ebd70f8-6540-4e5f-949d-429f6a8826d7 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:35.284586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0ebd70f8-6540-4e5f-949d-429f6a8826d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:35.418309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c3e2-5a25-4670-9ba0-70aa57e22c07 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:35.418309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c3e2-5a25-4670-9ba0-70aa57e22c07 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:35.418309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c3e2-5a25-4670-9ba0-70aa57e22c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:35.422936 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 986/1974] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:35.439954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0287c3e2-5a25-4670-9ba0-70aa57e22c07 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:35.443641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0287c3e2-5a25-4670-9ba0-70aa57e22c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:35.459957 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd70f8-6540-4e5f-949d-429f6a8826d7 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:35.482247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 989/1975] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:35.492038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd70f8-6540-4e5f-949d-429f6a8826d7 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:35.498296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:35.505349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:35.505349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:35.505349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:35.505349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:35.505349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:35.505349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:35.520311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 987/1976] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:35.525453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287c3e2-5a25-4670-9ba0-70aa57e22c07 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:35.561167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287c3e2-5a25-4670-9ba0-70aa57e22c07 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:35.594586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e156056-8b79-419b-b4cc-700f98527dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:35.606342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156056-8b79-419b-b4cc-700f98527dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:35.606714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156056-8b79-419b-b4cc-700f98527dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:35.606996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156056-8b79-419b-b4cc-700f98527dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:35.607759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e156056-8b79-419b-b4cc-700f98527dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:35.611759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e156056-8b79-419b-b4cc-700f98527dc6 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:35.751498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 990/1977] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:35 2022] POST /identity/v3/projects => generated 391 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:35.756138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:35.769114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b692d-0c77-40d8-99e1-2038cae29c02 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:35.843959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635dc5a-37bb-4011-ba58-8f111ec274cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:35.843959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635dc5a-37bb-4011-ba58-8f111ec274cd admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:35.843959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635dc5a-37bb-4011-ba58-8f111ec274cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:35.843959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635dc5a-37bb-4011-ba58-8f111ec274cd admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:35.849512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635dc5a-37bb-4011-ba58-8f111ec274cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:35.851361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635dc5a-37bb-4011-ba58-8f111ec274cd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:35.860541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:35.949565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 988/1978] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:35 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:35.954003 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e156056-8b79-419b-b4cc-700f98527dc6 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:35.972487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e156056-8b79-419b-b4cc-700f98527dc6 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:35.985062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f225b-855a-43cf-83b0-08da8e323d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:35.987943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f225b-855a-43cf-83b0-08da8e323d98 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:35.988480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f225b-855a-43cf-83b0-08da8e323d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:35.989595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f225b-855a-43cf-83b0-08da8e323d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:35.992805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f225b-855a-43cf-83b0-08da8e323d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:35.998640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f225b-855a-43cf-83b0-08da8e323d98 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:36.038059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 991/1979] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:36.044186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635dc5a-37bb-4011-ba58-8f111ec274cd admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:36.065593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635dc5a-37bb-4011-ba58-8f111ec274cd admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:36.080973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c33c2-1cff-483e-8bca-7a12925524f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:36.082834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c33c2-1cff-483e-8bca-7a12925524f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:36.083129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c33c2-1cff-483e-8bca-7a12925524f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:36.083456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c33c2-1cff-483e-8bca-7a12925524f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:36.084214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c33c2-1cff-483e-8bca-7a12925524f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:36.087489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c33c2-1cff-483e-8bca-7a12925524f6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:36.119126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 989/1980] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:36.123466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f225b-855a-43cf-83b0-08da8e323d98 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:36.142333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f225b-855a-43cf-83b0-08da8e323d98 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:36.152587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:36.153508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:36.153964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:36.154468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] PATH_INFO: `/v3/projects/7ec489425751496fad481621bbd53d65/users/f1123141dbfd4d828f0f5d8b6956efac/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:36.206643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec489425751496fad481621bbd53d65, user_id=f1123141dbfd4d828f0f5d8b6956efac, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:36.209898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:36.309116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 992/1981] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:36 2022] PUT /identity/v3/projects/7ec489425751496fad481621bbd53d65/users/f1123141dbfd4d828f0f5d8b6956efac/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:36.320164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de06e-1b2b-4152-ab57-89c7272a77ef None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:36.320695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de06e-1b2b-4152-ab57-89c7272a77ef None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:36.320695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de06e-1b2b-4152-ab57-89c7272a77ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:36.377759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-123de06e-1b2b-4152-ab57-89c7272a77ef None None] MFA Rules not processed for user `f1123141dbfd4d828f0f5d8b6956efac`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:36.379469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-123de06e-1b2b-4152-ab57-89c7272a77ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:36.494476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 990/1982] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:36.517919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:36.521111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:36.621813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181cb6-1f32-4625-8ccb-606521db8e31 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:36.625981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b7f78-0d53-412a-8310-ea5297ab9ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:36.636400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7f78-0d53-412a-8310-ea5297ab9ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:36.636400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7f78-0d53-412a-8310-ea5297ab9ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:36.636400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7f78-0d53-412a-8310-ea5297ab9ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:36.637815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b7f78-0d53-412a-8310-ea5297ab9ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:36.641794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b7f78-0d53-412a-8310-ea5297ab9ef4 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:36.658547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 993/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:36.725363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de06e-1b2b-4152-ab57-89c7272a77ef None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:36.734488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-123de06e-1b2b-4152-ab57-89c7272a77ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:36.840818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de06e-1b2b-4152-ab57-89c7272a77ef None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:36.850903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:36.856388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:36.856683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:36.857162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] PATH_INFO: `/v3/users/9d6cfdf5d4774d0db798a5ff3dfcc12f` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:36.859679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6cfdf5d4774d0db798a5ff3dfcc12f)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:36.862265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:37.108180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6cfdf5d4774d0db798a5ff3dfcc12f'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:37.233371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6cfdf5d4774d0db798a5ff3dfcc12f'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:37.268057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6cfdf5d4774d0db798a5ff3dfcc12f'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:37.270563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6cfdf5d4774d0db798a5ff3dfcc12f'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:37.292613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6cfdf5d4774d0db798a5ff3dfcc12f'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:37.305847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 991/1984] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:36 2022] DELETE /identity/v3/users/9d6cfdf5d4774d0db798a5ff3dfcc12f => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:37.310855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622b40-7682-4154-942e-063fe829aa8f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:37.314814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622b40-7682-4154-942e-063fe829aa8f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:37.314814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622b40-7682-4154-942e-063fe829aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:37.334834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-68622b40-7682-4154-942e-063fe829aa8f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:37.336967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-68622b40-7682-4154-942e-063fe829aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:37.424541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 994/1985] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:37.453421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:37.503599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:37.505172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:37.602417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09257ba7-eb57-46f9-b1f4-29c0342ccec6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:37.637323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a274caf-9010-4304-937b-085f3daa272d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:37.642046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a274caf-9010-4304-937b-085f3daa272d service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:37.642660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a274caf-9010-4304-937b-085f3daa272d service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:37.643243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a274caf-9010-4304-937b-085f3daa272d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:37.657212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a274caf-9010-4304-937b-085f3daa272d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:37.672418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a274caf-9010-4304-937b-085f3daa272d service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:37.700019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 992/1986] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:38.616174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622b40-7682-4154-942e-063fe829aa8f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:38.617825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-68622b40-7682-4154-942e-063fe829aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:38.639356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622b40-7682-4154-942e-063fe829aa8f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:38.650844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:38.652781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:38.653082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:38.653365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] PATH_INFO: `/v3/projects/d94ae26aa1184195830c0f7a919f71a7` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:38.658623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94ae26aa1184195830c0f7a919f71a7)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:38.663806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:38.718050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:38.858061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94ae26aa1184195830c0f7a919f71a7', 'request_id': 'req-c885c44a-a451-460f-8a08-93de7a78ad6a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:38.942355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94ae26aa1184195830c0f7a919f71a7', 'request_id': 'req-c885c44a-a451-460f-8a08-93de7a78ad6a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:38.951716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94ae26aa1184195830c0f7a919f71a7', 'request_id': 'req-c885c44a-a451-460f-8a08-93de7a78ad6a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:38.997456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] The token cache is being invalidate because project d94ae26aa1184195830c0f7a919f71a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:38.998402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:39.002372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:39.009644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 995/1987] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:38 2022] DELETE /identity/v3/projects/d94ae26aa1184195830c0f7a919f71a7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:39.013798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a274caf-9010-4304-937b-085f3daa272d service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:39.029751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a274caf-9010-4304-937b-085f3daa272d service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:39.168348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:39.169640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:39.170176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:39.170694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] PATH_INFO: `/v3/users/181cf7d511b449b490e46ac32e363915` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:39.173067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181cf7d511b449b490e46ac32e363915)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:39.175519 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:39.509975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181cf7d511b449b490e46ac32e363915'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:39.598733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181cf7d511b449b490e46ac32e363915'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:39.629001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181cf7d511b449b490e46ac32e363915'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:39.632728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181cf7d511b449b490e46ac32e363915'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:39.649106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bd6d8e77-d3de-4d72-a3e8-4063b8c22625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181cf7d511b449b490e46ac32e363915'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:39.658723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 993/1988] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:39 2022] DELETE /identity/v3/users/181cf7d511b449b490e46ac32e363915 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:42.299743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:42.303211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:42.330228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885c44a-a451-460f-8a08-93de7a78ad6a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:42.461275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:42.462468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:42.463032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:42.463469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] PATH_INFO: `/v3/projects/e52212f65a57433ba626240dde67d7e4` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:42.466914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52212f65a57433ba626240dde67d7e4)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:42.469071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:42.677910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52212f65a57433ba626240dde67d7e4', 'request_id': 'req-888e88ae-b089-42ca-928c-29be271429c4'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:42.883743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52212f65a57433ba626240dde67d7e4', 'request_id': 'req-888e88ae-b089-42ca-928c-29be271429c4'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:42.894625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52212f65a57433ba626240dde67d7e4', 'request_id': 'req-888e88ae-b089-42ca-928c-29be271429c4'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:42.924390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] The token cache is being invalidate because project e52212f65a57433ba626240dde67d7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:42.924692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:42.928604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-888e88ae-b089-42ca-928c-29be271429c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:42.932959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 996/1989] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:42 2022] DELETE /identity/v3/projects/e52212f65a57433ba626240dde67d7e4 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:42.939108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0eab-c2c4-450f-a8fa-2adfc0d34d1b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:42.939707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0eab-c2c4-450f-a8fa-2adfc0d34d1b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:42.939882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0eab-c2c4-450f-a8fa-2adfc0d34d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:42.973830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d0bc0eab-c2c4-450f-a8fa-2adfc0d34d1b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:42.975371 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d0bc0eab-c2c4-450f-a8fa-2adfc0d34d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:42.995845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:43.114202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 994/1990] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:43.121450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841d86-8705-4b3b-90d3-169a99f87c3c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:43.121749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841d86-8705-4b3b-90d3-169a99f87c3c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:43.122035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841d86-8705-4b3b-90d3-169a99f87c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:43.168106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f4841d86-8705-4b3b-90d3-169a99f87c3c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:43.169376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f4841d86-8705-4b3b-90d3-169a99f87c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:43.193421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 997/1991] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:43.197976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc0eab-c2c4-450f-a8fa-2adfc0d34d1b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:43.215520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc0eab-c2c4-450f-a8fa-2adfc0d34d1b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:43.230892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:43.238012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:43.238012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:43.238012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:43.238012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:43.248445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:43.255536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:43.290560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 995/1992] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:54:43.297354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4841d86-8705-4b3b-90d3-169a99f87c3c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:43.310879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4841d86-8705-4b3b-90d3-169a99f87c3c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:43.327049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6211-c470-488e-80ae-cec7a73ce10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:43.328021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6211-c470-488e-80ae-cec7a73ce10c admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:43.329445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6211-c470-488e-80ae-cec7a73ce10c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:43.330632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6211-c470-488e-80ae-cec7a73ce10c admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:43.331533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6211-c470-488e-80ae-cec7a73ce10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:43.336183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6211-c470-488e-80ae-cec7a73ce10c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:43.486040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 998/1993] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:43 2022] POST /identity/v3/projects => generated 397 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:43.490994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:43.508584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2dd69-f39d-422e-b89b-7f2cd1edb002 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:43.622718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ed5d3-6d08-4f1d-83f3-ddaa317e701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:43.623423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed5d3-6d08-4f1d-83f3-ddaa317e701a admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:43.623712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed5d3-6d08-4f1d-83f3-ddaa317e701a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:43.623995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed5d3-6d08-4f1d-83f3-ddaa317e701a admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:43.633991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ed5d3-6d08-4f1d-83f3-ddaa317e701a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:43.638604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ed5d3-6d08-4f1d-83f3-ddaa317e701a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:43.795225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 996/1994] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:43 2022] POST /identity/v3/users => generated 299 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:43.801751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6211-c470-488e-80ae-cec7a73ce10c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:43.822596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6211-c470-488e-80ae-cec7a73ce10c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:43.836320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09221e-1441-40c1-960b-14772e138668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:43.838317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09221e-1441-40c1-960b-14772e138668 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:43.840286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09221e-1441-40c1-960b-14772e138668 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:43.841878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09221e-1441-40c1-960b-14772e138668 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:43.842843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09221e-1441-40c1-960b-14772e138668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:43.851734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09221e-1441-40c1-960b-14772e138668 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:43.858342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:43.878858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 999/1995] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:43.883608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ed5d3-6d08-4f1d-83f3-ddaa317e701a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:43.902156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ed5d3-6d08-4f1d-83f3-ddaa317e701a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:43.921849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909dc75-0ef8-4e18-9840-85b3fee916b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:43.922850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909dc75-0ef8-4e18-9840-85b3fee916b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:43.923226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909dc75-0ef8-4e18-9840-85b3fee916b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:43.923507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909dc75-0ef8-4e18-9840-85b3fee916b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:43.926158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909dc75-0ef8-4e18-9840-85b3fee916b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:43.929104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909dc75-0ef8-4e18-9840-85b3fee916b0 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:43.952587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 997/1996] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:43.956983 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09221e-1441-40c1-960b-14772e138668 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:43.970884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09221e-1441-40c1-960b-14772e138668 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:43.985612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:43.987224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:43.987740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:43.988248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] PATH_INFO: `/v3/projects/1f3c0b2968364f7d93796367588d1247/users/067e302e1a2447afa9e33a4e04551830/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:44.031371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3c0b2968364f7d93796367588d1247, user_id=067e302e1a2447afa9e33a4e04551830, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:44.035086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:44.177800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1000/1997] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:43 2022] PUT /identity/v3/projects/1f3c0b2968364f7d93796367588d1247/users/067e302e1a2447afa9e33a4e04551830/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:44.189106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18e5b9-c753-49b1-b828-7be64e87a218 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:44.189643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18e5b9-c753-49b1-b828-7be64e87a218 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:44.190071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18e5b9-c753-49b1-b828-7be64e87a218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:44.246943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-2b18e5b9-c753-49b1-b828-7be64e87a218 None None] MFA Rules not processed for user `067e302e1a2447afa9e33a4e04551830`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:44.257435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2b18e5b9-c753-49b1-b828-7be64e87a218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:44.374826 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 998/1998] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:44.396401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:44.398787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:44.499957 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b661d-1b76-4ac6-8cf5-498ed339d979 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:44.507057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45310a-855d-4e29-902e-d3d25cd40d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:44.508549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45310a-855d-4e29-902e-d3d25cd40d1b service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:44.509059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45310a-855d-4e29-902e-d3d25cd40d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:44.509831 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45310a-855d-4e29-902e-d3d25cd40d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:44.524304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45310a-855d-4e29-902e-d3d25cd40d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:44.527039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45310a-855d-4e29-902e-d3d25cd40d1b service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:44.549021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1001/1999] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:48.274908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18e5b9-c753-49b1-b828-7be64e87a218 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:48.276693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2b18e5b9-c753-49b1-b828-7be64e87a218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:48.285136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:48.371523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18e5b9-c753-49b1-b828-7be64e87a218 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:48.376937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:48.377853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:48.378153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:48.378539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] PATH_INFO: `/v3/users/1be32873139d497ea5640c5f12ecc8a7` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:48.379639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be32873139d497ea5640c5f12ecc8a7)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:48.382207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:48.648518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be32873139d497ea5640c5f12ecc8a7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:48.734970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be32873139d497ea5640c5f12ecc8a7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:48.760093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be32873139d497ea5640c5f12ecc8a7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:48.760962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be32873139d497ea5640c5f12ecc8a7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:48.777111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be32873139d497ea5640c5f12ecc8a7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:48.787203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 999/2000] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:48 2022] DELETE /identity/v3/users/1be32873139d497ea5640c5f12ecc8a7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:48.797429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135458fa-2562-4643-a8d8-f716394569c1 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:48.797989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135458fa-2562-4643-a8d8-f716394569c1 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:48.797989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135458fa-2562-4643-a8d8-f716394569c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:48.823464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-135458fa-2562-4643-a8d8-f716394569c1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:48.824875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-135458fa-2562-4643-a8d8-f716394569c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:48.922959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1002/2001] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:48.937407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:48.939097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:49.032841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5d5ee-35a9-43ea-8013-41256c615635 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:49.048078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e0a8e-a4e2-4f5e-b0e1-b0d4ec2be128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:49.049202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0a8e-a4e2-4f5e-b0e1-b0d4ec2be128 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:49.049871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0a8e-a4e2-4f5e-b0e1-b0d4ec2be128 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:49.050333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0a8e-a4e2-4f5e-b0e1-b0d4ec2be128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:49.063343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e0a8e-a4e2-4f5e-b0e1-b0d4ec2be128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:49.065674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e0a8e-a4e2-4f5e-b0e1-b0d4ec2be128 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:49.085224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1000/2002] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:50.550683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135458fa-2562-4643-a8d8-f716394569c1 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:50.553371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-135458fa-2562-4643-a8d8-f716394569c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:50.570285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135458fa-2562-4643-a8d8-f716394569c1 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:50.576789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:50.577969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:50.579311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:50.585779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] PATH_INFO: `/v3/projects/a1798dbd162241c0ac58506e584e5e6d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:50.585779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1798dbd162241c0ac58506e584e5e6d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:50.596410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:50.785876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1798dbd162241c0ac58506e584e5e6d', 'request_id': 'req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.860698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1798dbd162241c0ac58506e584e5e6d', 'request_id': 'req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.880501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1798dbd162241c0ac58506e584e5e6d', 'request_id': 'req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.920902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:50.926190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] The token cache is being invalidate because project a1798dbd162241c0ac58506e584e5e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:50.926491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.927411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e32b261-bd3d-4ff5-948e-ef22dbb68bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.929342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1003/2003] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:50 2022] DELETE /identity/v3/projects/a1798dbd162241c0ac58506e584e5e6d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:50.934568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e55b3-9691-407c-82b4-7b60adaeb4cf None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:50.935538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e55b3-9691-407c-82b4-7b60adaeb4cf None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:50.935983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e55b3-9691-407c-82b4-7b60adaeb4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:50.963483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-132e55b3-9691-407c-82b4-7b60adaeb4cf None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:50.968639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-132e55b3-9691-407c-82b4-7b60adaeb4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:50.998968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:51.060556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1001/2004] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:51.061989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd4092-628f-4268-8c75-c52f5c83073d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.062316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd4092-628f-4268-8c75-c52f5c83073d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.062607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd4092-628f-4268-8c75-c52f5c83073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.118598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f2bd4092-628f-4268-8c75-c52f5c83073d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:51.119881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f2bd4092-628f-4268-8c75-c52f5c83073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:51.136000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1004/2005] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:51.140699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e55b3-9691-407c-82b4-7b60adaeb4cf None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.154790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e55b3-9691-407c-82b4-7b60adaeb4cf None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.164953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.165953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.166444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.166890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.167948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:51.168443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.170279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.188854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1002/2006] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:51.193666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd4092-628f-4268-8c75-c52f5c83073d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.205433 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd4092-628f-4268-8c75-c52f5c83073d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.218912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd494ad-ea32-4ec6-bbf8-fbcb82243649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.219800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd494ad-ea32-4ec6-bbf8-fbcb82243649 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.220160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd494ad-ea32-4ec6-bbf8-fbcb82243649 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.222943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd494ad-ea32-4ec6-bbf8-fbcb82243649 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.223871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd494ad-ea32-4ec6-bbf8-fbcb82243649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.236295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd494ad-ea32-4ec6-bbf8-fbcb82243649 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.383365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1005/2007] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:51 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:51.383928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.395866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c517d-a971-414c-b89a-0cd1294dee3f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.539812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97d82-487e-4979-8b43-8c5b80a7fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.541554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97d82-487e-4979-8b43-8c5b80a7fe31 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.543718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97d82-487e-4979-8b43-8c5b80a7fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.544024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97d82-487e-4979-8b43-8c5b80a7fe31 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.545190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b97d82-487e-4979-8b43-8c5b80a7fe31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.557490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b97d82-487e-4979-8b43-8c5b80a7fe31 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.728054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1003/2008] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:51 2022] POST /identity/v3/users => generated 291 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:54:51.734661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd494ad-ea32-4ec6-bbf8-fbcb82243649 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.749961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd494ad-ea32-4ec6-bbf8-fbcb82243649 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.762726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b1adc-db69-4f36-b960-43587e4b3fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.763981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b1adc-db69-4f36-b960-43587e4b3fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.764432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b1adc-db69-4f36-b960-43587e4b3fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.764881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b1adc-db69-4f36-b960-43587e4b3fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.770006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b1adc-db69-4f36-b960-43587e4b3fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.771059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b1adc-db69-4f36-b960-43587e4b3fa6 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.808689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1006/2009] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:51.811653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97d82-487e-4979-8b43-8c5b80a7fe31 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.836403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97d82-487e-4979-8b43-8c5b80a7fe31 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.846144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16978e-2d15-4da2-8fee-4273536c89e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.846921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16978e-2d15-4da2-8fee-4273536c89e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.847309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16978e-2d15-4da2-8fee-4273536c89e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.847686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16978e-2d15-4da2-8fee-4273536c89e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.848522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16978e-2d15-4da2-8fee-4273536c89e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.850970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16978e-2d15-4da2-8fee-4273536c89e5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.881074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1004/2010] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:51.885395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b1adc-db69-4f36-b960-43587e4b3fa6 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.913748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b1adc-db69-4f36-b960-43587e4b3fa6 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.923454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.924740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.925129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.925507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] PATH_INFO: `/v3/projects/1df7e0be697c49dda2ee4f9d37747f53/users/39146179cac44355915f4c89c18a1345/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.970537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df7e0be697c49dda2ee4f9d37747f53, user_id=39146179cac44355915f4c89c18a1345, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.973405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:52.084615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1007/2011] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:51 2022] PUT /identity/v3/projects/1df7e0be697c49dda2ee4f9d37747f53/users/39146179cac44355915f4c89c18a1345/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:52.084817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31b5f-5151-4498-b12f-79e7cc27e5d5 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:52.084817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31b5f-5151-4498-b12f-79e7cc27e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:52.084817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31b5f-5151-4498-b12f-79e7cc27e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:52.143710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-bff31b5f-5151-4498-b12f-79e7cc27e5d5 None None] MFA Rules not processed for user `39146179cac44355915f4c89c18a1345`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:52.145121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bff31b5f-5151-4498-b12f-79e7cc27e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:52.291295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1005/2012] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:52.398036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:52.400081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:52.551026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a02d2-6236-4b1f-a0dd-4233e3211ac0 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:52.557940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997d2ca-0e85-4fa0-956e-fa8befc29b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:52.558838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997d2ca-0e85-4fa0-956e-fa8befc29b6f service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:52.559193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997d2ca-0e85-4fa0-956e-fa8befc29b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:52.559642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997d2ca-0e85-4fa0-956e-fa8befc29b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:52.570586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997d2ca-0e85-4fa0-956e-fa8befc29b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:52.572482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997d2ca-0e85-4fa0-956e-fa8befc29b6f service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:52.586263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1008/2013] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:52.663473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff31b5f-5151-4498-b12f-79e7cc27e5d5 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:52.711736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:52.793593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff31b5f-5151-4498-b12f-79e7cc27e5d5 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:52.802844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:52.804833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:52.805392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:52.805875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] PATH_INFO: `/v3/users/39146179cac44355915f4c89c18a1345` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:52.813808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39146179cac44355915f4c89c18a1345)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:52.822633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:53.055057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39146179cac44355915f4c89c18a1345'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.161153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39146179cac44355915f4c89c18a1345'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.179059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39146179cac44355915f4c89c18a1345'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.184121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39146179cac44355915f4c89c18a1345'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.208896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39146179cac44355915f4c89c18a1345'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.217899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1006/2014] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:52 2022] DELETE /identity/v3/users/39146179cac44355915f4c89c18a1345 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:53.223332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e398-c2ab-434f-a1a8-1834ac11839d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:53.223908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e398-c2ab-434f-a1a8-1834ac11839d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:53.223989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e398-c2ab-434f-a1a8-1834ac11839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:53.261406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c650e398-c2ab-434f-a1a8-1834ac11839d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:53.263633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c650e398-c2ab-434f-a1a8-1834ac11839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:53.418557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1009/2015] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:53.468352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:53.471051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:53.632824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97aed6-bca1-44eb-b309-9544f533d5f0 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:53.640490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616608-c7cb-4897-a678-7c5938d7d0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:53.640490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616608-c7cb-4897-a678-7c5938d7d0fb service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:53.640490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616608-c7cb-4897-a678-7c5938d7d0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:53.640490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616608-c7cb-4897-a678-7c5938d7d0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:53.663020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616608-c7cb-4897-a678-7c5938d7d0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:53.666146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616608-c7cb-4897-a678-7c5938d7d0fb service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:53.679654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1007/2016] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:54.130559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650e398-c2ab-434f-a1a8-1834ac11839d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:54.132026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c650e398-c2ab-434f-a1a8-1834ac11839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:54.150854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650e398-c2ab-434f-a1a8-1834ac11839d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:54.158842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:54.159753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:54.160113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:54.164098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] PATH_INFO: `/v3/users/f1123141dbfd4d828f0f5d8b6956efac` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:54.166145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1123141dbfd4d828f0f5d8b6956efac)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:54.181063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:54.464699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:54.479467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1123141dbfd4d828f0f5d8b6956efac'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:54.563900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1123141dbfd4d828f0f5d8b6956efac'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:54.587139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1123141dbfd4d828f0f5d8b6956efac'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:54.611510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1123141dbfd4d828f0f5d8b6956efac'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:54.612950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1123141dbfd4d828f0f5d8b6956efac'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:54.628623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1010/2017] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:54 2022] DELETE /identity/v3/users/f1123141dbfd4d828f0f5d8b6956efac => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:54.629334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f184cc-dd65-4698-825c-2e64299c369b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:54.632846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f184cc-dd65-4698-825c-2e64299c369b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:54.632846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f184cc-dd65-4698-825c-2e64299c369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:54.662850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-05f184cc-dd65-4698-825c-2e64299c369b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:54.664334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-05f184cc-dd65-4698-825c-2e64299c369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:54.741324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:54.769568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1008/2018] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:54.777180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:54.778786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:54.870907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763edc9-d686-4094-8da6-226a054c0faf admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:54.887827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:54.888830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:54.889304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:54.889810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:54.903576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:54.905375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:54.920387 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1011/2019] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:54:56.222066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f184cc-dd65-4698-825c-2e64299c369b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:56.223717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-05f184cc-dd65-4698-825c-2e64299c369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:56.243709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f184cc-dd65-4698-825c-2e64299c369b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:56.253344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:56.256042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.256574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.257102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] PATH_INFO: `/v3/projects/1df7e0be697c49dda2ee4f9d37747f53` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.267572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df7e0be697c49dda2ee4f9d37747f53)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:56.278587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:56.280444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:56.282174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:56.313174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2c9b-8c76-47cd-88d5-4891371dc7e6 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:56.326449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:56.327364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.327650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.329216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] PATH_INFO: `/v3/projects/7ec489425751496fad481621bbd53d65` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.331749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec489425751496fad481621bbd53d65)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:56.337490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:56.483699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df7e0be697c49dda2ee4f9d37747f53', 'request_id': 'req-6816ec10-b51d-40f9-854d-05cf7f15d15e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.511769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec489425751496fad481621bbd53d65', 'request_id': 'req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.545294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df7e0be697c49dda2ee4f9d37747f53', 'request_id': 'req-6816ec10-b51d-40f9-854d-05cf7f15d15e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.554482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df7e0be697c49dda2ee4f9d37747f53', 'request_id': 'req-6816ec10-b51d-40f9-854d-05cf7f15d15e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.570717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] The token cache is being invalidate because project 1df7e0be697c49dda2ee4f9d37747f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:56.571258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.574765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6816ec10-b51d-40f9-854d-05cf7f15d15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.583024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1009/2020] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:56 2022] DELETE /identity/v3/projects/1df7e0be697c49dda2ee4f9d37747f53 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:56.584949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e34d-8860-4bd0-b0cc-ca644d5a1b55 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.585270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e34d-8860-4bd0-b0cc-ca644d5a1b55 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.585850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e34d-8860-4bd0-b0cc-ca644d5a1b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.611594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ad38e34d-8860-4bd0-b0cc-ca644d5a1b55 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:56.612987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ad38e34d-8860-4bd0-b0cc-ca644d5a1b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:56.632082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec489425751496fad481621bbd53d65', 'request_id': 'req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.644139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec489425751496fad481621bbd53d65', 'request_id': 'req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.666932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] The token cache is being invalidate because project 7ec489425751496fad481621bbd53d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:56.669454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.672289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-794bb148-c9d8-4f35-8ef9-3bd8946a64d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:56.675397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1012/2021] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:56 2022] DELETE /identity/v3/projects/7ec489425751496fad481621bbd53d65 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:56.685518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae3231-229f-4855-8bd2-87dfaf96994d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.687304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae3231-229f-4855-8bd2-87dfaf96994d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.687770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae3231-229f-4855-8bd2-87dfaf96994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.731402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-bfae3231-229f-4855-8bd2-87dfaf96994d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:56.732674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bfae3231-229f-4855-8bd2-87dfaf96994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:56.787241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1010/2022] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:56.790907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:56.838844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1013/2023] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:56.841217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971685d-a9d0-41aa-9ed9-344de0704748 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.841728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971685d-a9d0-41aa-9ed9-344de0704748 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.842193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971685d-a9d0-41aa-9ed9-344de0704748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.856522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803291fb-89c6-498f-a0a2-26e545b2feb9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.857026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803291fb-89c6-498f-a0a2-26e545b2feb9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.857460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803291fb-89c6-498f-a0a2-26e545b2feb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.886715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-803291fb-89c6-498f-a0a2-26e545b2feb9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:56.888429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-803291fb-89c6-498f-a0a2-26e545b2feb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:56.890355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4971685d-a9d0-41aa-9ed9-344de0704748 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:56.891572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4971685d-a9d0-41aa-9ed9-344de0704748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:56.905595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1014/2024] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:56.909385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803291fb-89c6-498f-a0a2-26e545b2feb9 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:56.917597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1011/2025] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:56.921668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971685d-a9d0-41aa-9ed9-344de0704748 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:56.931621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803291fb-89c6-498f-a0a2-26e545b2feb9 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:56.937455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:56.938734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.939003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971685d-a9d0-41aa-9ed9-344de0704748 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:56.939484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.939917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.940877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:56.941549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:56.943532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:56.958802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:56.958802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.958802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.958802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.959193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:56.959193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:56.959193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:56.963248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1015/2026] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:56.965063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:56.978438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04269fe-38e0-4b97-af3e-f3c749adfee7 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:56.985186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1012/2027] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:54:56.991425 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:56.993936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d588-789e-44cc-9ce5-d99a98202145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:56.994818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d588-789e-44cc-9ce5-d99a98202145 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.995168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d588-789e-44cc-9ce5-d99a98202145 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.995802 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d588-789e-44cc-9ce5-d99a98202145 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.996888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4d588-789e-44cc-9ce5-d99a98202145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:56.999680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4d588-789e-44cc-9ce5-d99a98202145 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.005389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9e51-d59e-47ad-8145-bb1b58857831 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.014060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2f45-285d-465d-9936-7c74e8218f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.015026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2f45-285d-465d-9936-7c74e8218f47 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.016028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2f45-285d-465d-9936-7c74e8218f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.016028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2f45-285d-465d-9936-7c74e8218f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.016746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d2f45-285d-465d-9936-7c74e8218f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.019293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d2f45-285d-465d-9936-7c74e8218f47 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.127032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1016/2028] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:56 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:57.131555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d588-789e-44cc-9ce5-d99a98202145 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.167115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1013/2029] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:56 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:57.172726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2f45-285d-465d-9936-7c74e8218f47 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.209836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:57.253738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2f45-285d-465d-9936-7c74e8218f47 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.261364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306a88-61fe-4b45-a3ef-18db93b0efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.262666 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306a88-61fe-4b45-a3ef-18db93b0efe6 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.263171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306a88-61fe-4b45-a3ef-18db93b0efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.263719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306a88-61fe-4b45-a3ef-18db93b0efe6 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.264238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d588-789e-44cc-9ce5-d99a98202145 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.265114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1306a88-61fe-4b45-a3ef-18db93b0efe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.268043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1306a88-61fe-4b45-a3ef-18db93b0efe6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.279084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d54b-d6ed-4240-a0b7-02082a3e18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.279788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d54b-d6ed-4240-a0b7-02082a3e18c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.280246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d54b-d6ed-4240-a0b7-02082a3e18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.280687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d54b-d6ed-4240-a0b7-02082a3e18c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.283643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158d54b-d6ed-4240-a0b7-02082a3e18c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.283643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158d54b-d6ed-4240-a0b7-02082a3e18c4 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.419456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1014/2030] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:57 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:57.420416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306a88-61fe-4b45-a3ef-18db93b0efe6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.421075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1017/2031] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:57 2022] POST /identity/v3/users => generated 285 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:54:57.424817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d54b-d6ed-4240-a0b7-02082a3e18c4 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.434058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306a88-61fe-4b45-a3ef-18db93b0efe6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.442893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bea9fe-b7b7-4bb5-8cff-d5b187f8157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.444108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d54b-d6ed-4240-a0b7-02082a3e18c4 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.444534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea9fe-b7b7-4bb5-8cff-d5b187f8157a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.444979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea9fe-b7b7-4bb5-8cff-d5b187f8157a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.445593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea9fe-b7b7-4bb5-8cff-d5b187f8157a admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.446655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bea9fe-b7b7-4bb5-8cff-d5b187f8157a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.450163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bea9fe-b7b7-4bb5-8cff-d5b187f8157a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.451074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5438d-eaf3-499b-8dc0-77305adc0a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.451958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5438d-eaf3-499b-8dc0-77305adc0a00 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.452310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5438d-eaf3-499b-8dc0-77305adc0a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.452866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5438d-eaf3-499b-8dc0-77305adc0a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.455069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5438d-eaf3-499b-8dc0-77305adc0a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.456988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5438d-eaf3-499b-8dc0-77305adc0a00 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.470934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1015/2032] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:57.473671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bea9fe-b7b7-4bb5-8cff-d5b187f8157a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.482649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1018/2033] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:57.483833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5438d-eaf3-499b-8dc0-77305adc0a00 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.486307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bea9fe-b7b7-4bb5-8cff-d5b187f8157a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.492797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcda69-cd17-4cec-9afb-810807981ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.494297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcda69-cd17-4cec-9afb-810807981ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.494766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcda69-cd17-4cec-9afb-810807981ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.495209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcda69-cd17-4cec-9afb-810807981ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.497785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcda69-cd17-4cec-9afb-810807981ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.497957 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcda69-cd17-4cec-9afb-810807981ba1 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.512192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1016/2034] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:57.516046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5438d-eaf3-499b-8dc0-77305adc0a00 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.517206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcda69-cd17-4cec-9afb-810807981ba1 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.530738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcda69-cd17-4cec-9afb-810807981ba1 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.532008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc07e-49e9-4365-8b04-33dd7b8928dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.533035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc07e-49e9-4365-8b04-33dd7b8928dc admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.533489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc07e-49e9-4365-8b04-33dd7b8928dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.533789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc07e-49e9-4365-8b04-33dd7b8928dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.535445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fc07e-49e9-4365-8b04-33dd7b8928dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.537228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ad44a-2fa9-47b7-8e0f-304157368228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.538265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad44a-2fa9-47b7-8e0f-304157368228 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.538780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad44a-2fa9-47b7-8e0f-304157368228 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.539116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fc07e-49e9-4365-8b04-33dd7b8928dc admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.539479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad44a-2fa9-47b7-8e0f-304157368228 admin admin] PATH_INFO: `/v3/projects/5717ab0b033a42e39390785e356742f4/users/9c4a937c0ec44f90af5be495ce3c5c4c/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.574364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1019/2035] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:57.574864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ad44a-2fa9-47b7-8e0f-304157368228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5717ab0b033a42e39390785e356742f4, user_id=9c4a937c0ec44f90af5be495ce3c5c4c, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.578262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc07e-49e9-4365-8b04-33dd7b8928dc admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.578467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ad44a-2fa9-47b7-8e0f-304157368228 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.591944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc07e-49e9-4365-8b04-33dd7b8928dc admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:57.606966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24a4d3-dc92-4314-8fe2-c5f8c16cf5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:57.606966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a4d3-dc92-4314-8fe2-c5f8c16cf5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.606966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a4d3-dc92-4314-8fe2-c5f8c16cf5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.606966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a4d3-dc92-4314-8fe2-c5f8c16cf5bc admin admin] PATH_INFO: `/v3/projects/f7d619deb6fa4cdeb49ee613957d6a6f/users/45f7ce866642483b809d9d7bd541aa6a/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.633217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24a4d3-dc92-4314-8fe2-c5f8c16cf5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d619deb6fa4cdeb49ee613957d6a6f, user_id=45f7ce866642483b809d9d7bd541aa6a, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:57.636077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24a4d3-dc92-4314-8fe2-c5f8c16cf5bc admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:57.684735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1017/2036] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:57 2022] PUT /identity/v3/projects/5717ab0b033a42e39390785e356742f4/users/9c4a937c0ec44f90af5be495ce3c5c4c/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:57.695780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184a298-7463-4f65-99eb-03c7c430ec64 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.696163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184a298-7463-4f65-99eb-03c7c430ec64 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.696577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184a298-7463-4f65-99eb-03c7c430ec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.734452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-2184a298-7463-4f65-99eb-03c7c430ec64 None None] MFA Rules not processed for user `9c4a937c0ec44f90af5be495ce3c5c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:57.736667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2184a298-7463-4f65-99eb-03c7c430ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:57.756558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1020/2037] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:57 2022] PUT /identity/v3/projects/f7d619deb6fa4cdeb49ee613957d6a6f/users/45f7ce866642483b809d9d7bd541aa6a/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:57.767331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13070ea-406b-4111-919f-47f779527e35 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:57.767628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13070ea-406b-4111-919f-47f779527e35 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:57.767911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13070ea-406b-4111-919f-47f779527e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:57.836109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c13070ea-406b-4111-919f-47f779527e35 None None] MFA Rules not processed for user `45f7ce866642483b809d9d7bd541aa6a`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:57.837821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c13070ea-406b-4111-919f-47f779527e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:57.890292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1018/2038] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:57.895327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184a298-7463-4f65-99eb-03c7c430ec64 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.896881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2184a298-7463-4f65-99eb-03c7c430ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:57.946442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1021/2039] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:57.987762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13070ea-406b-4111-919f-47f779527e35 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:57.994093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184a298-7463-4f65-99eb-03c7c430ec64 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:58.019411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:58.055227 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27861a3a-9da9-4515-a9de-4381ecda6153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:58.055953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861a3a-9da9-4515-a9de-4381ecda6153 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:58.056239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861a3a-9da9-4515-a9de-4381ecda6153 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:58.057103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861a3a-9da9-4515-a9de-4381ecda6153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:58.109046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13070ea-406b-4111-919f-47f779527e35 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:58.116929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:58.117678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:58.117977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:58.118347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:58.136006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:58.137713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:58.163154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1022/2040] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:54:58.171358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27861a3a-9da9-4515-a9de-4381ecda6153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:58.173618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27861a3a-9da9-4515-a9de-4381ecda6153 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:58.187074 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1019/2041] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:58.290537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:09.048892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=40 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:09.341026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=41 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:22.590421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:22.591801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:22.731302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788457f-4c8b-48f8-84fa-61b79ce1b701 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:22.739410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:22.741297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:22.741785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:22.742369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] PATH_INFO: `/v3/users/067e302e1a2447afa9e33a4e04551830` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:22.744661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=067e302e1a2447afa9e33a4e04551830)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:22.747837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:23.011383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067e302e1a2447afa9e33a4e04551830'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:23.137814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067e302e1a2447afa9e33a4e04551830'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:23.174729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067e302e1a2447afa9e33a4e04551830'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:23.187293 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067e302e1a2447afa9e33a4e04551830'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:23.188843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067e302e1a2447afa9e33a4e04551830'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:23.204797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1023/2042] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:22 2022] DELETE /identity/v3/users/067e302e1a2447afa9e33a4e04551830 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:55:23.210431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c0448-b224-4d58-8225-ebed92429a91 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:23.214185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c0448-b224-4d58-8225-ebed92429a91 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:23.214185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c0448-b224-4d58-8225-ebed92429a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:23.234738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-bc3c0448-b224-4d58-8225-ebed92429a91 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:23.236572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bc3c0448-b224-4d58-8225-ebed92429a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:23.339744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1020/2043] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:23.360065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:23.361872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:23.494092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395fe1-d524-428d-ba09-0b5cb5da5dbd admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:23.504727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39153946-aed5-4035-bb19-c2cd6b9a5680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:23.506139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39153946-aed5-4035-bb19-c2cd6b9a5680 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:23.506793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39153946-aed5-4035-bb19-c2cd6b9a5680 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:23.507941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39153946-aed5-4035-bb19-c2cd6b9a5680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:23.526216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39153946-aed5-4035-bb19-c2cd6b9a5680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:23.528155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39153946-aed5-4035-bb19-c2cd6b9a5680 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:23.545969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1024/2044] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:24.450944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c0448-b224-4d58-8225-ebed92429a91 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:24.453496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bc3c0448-b224-4d58-8225-ebed92429a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:24.473677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c0448-b224-4d58-8225-ebed92429a91 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:24.483446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:24.483446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:24.483446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:24.483446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] PATH_INFO: `/v3/projects/1f3c0b2968364f7d93796367588d1247` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:24.484082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3c0b2968364f7d93796367588d1247)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:24.486233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:24.756640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3c0b2968364f7d93796367588d1247', 'request_id': 'req-4974f59e-a857-452f-925b-848f1d1f1816'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:24.872098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3c0b2968364f7d93796367588d1247', 'request_id': 'req-4974f59e-a857-452f-925b-848f1d1f1816'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:24.905789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3c0b2968364f7d93796367588d1247', 'request_id': 'req-4974f59e-a857-452f-925b-848f1d1f1816'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:25.001538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] The token cache is being invalidate because project 1f3c0b2968364f7d93796367588d1247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:25.005607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:25.011445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4974f59e-a857-452f-925b-848f1d1f1816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:25.025378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1021/2045] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:24 2022] DELETE /identity/v3/projects/1f3c0b2968364f7d93796367588d1247 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:25.027799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487e5e-e158-4c8d-ad7b-9740cdf7fd08 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:25.028280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487e5e-e158-4c8d-ad7b-9740cdf7fd08 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:25.028389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487e5e-e158-4c8d-ad7b-9740cdf7fd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:25.073467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-30487e5e-e158-4c8d-ad7b-9740cdf7fd08 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:25.075217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-30487e5e-e158-4c8d-ad7b-9740cdf7fd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:25.119824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:25.361311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1025/2046] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:25.370343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2744b-54b1-42d9-b206-0109abb83b83 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:25.370748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2744b-54b1-42d9-b206-0109abb83b83 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:25.371118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2744b-54b1-42d9-b206-0109abb83b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:25.393976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-43e2744b-54b1-42d9-b206-0109abb83b83 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:25.396251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-43e2744b-54b1-42d9-b206-0109abb83b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:25.406021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1022/2047] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:25.410190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30487e5e-e158-4c8d-ad7b-9740cdf7fd08 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:25.423598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30487e5e-e158-4c8d-ad7b-9740cdf7fd08 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:25.431176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:25.432266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:25.432778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:25.433217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:25.434276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:25.434817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:25.437255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:25.458299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1026/2048] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:25.463100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2744b-54b1-42d9-b206-0109abb83b83 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:25.479119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2744b-54b1-42d9-b206-0109abb83b83 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:25.485591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9aa134-afe3-4bcb-b32b-33a5f779ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:25.487073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa134-afe3-4bcb-b32b-33a5f779ad1f admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:25.487581 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa134-afe3-4bcb-b32b-33a5f779ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:25.488031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa134-afe3-4bcb-b32b-33a5f779ad1f admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:25.489039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9aa134-afe3-4bcb-b32b-33a5f779ad1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:25.491883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9aa134-afe3-4bcb-b32b-33a5f779ad1f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:25.627335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1023/2049] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:25 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:25.632344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:25.650206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a77a2-d5dd-4b9d-972e-405604350e4b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:25.756682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7937e3-3fa9-418f-97e7-17dd016ae9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:25.757388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7937e3-3fa9-418f-97e7-17dd016ae9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:25.757672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7937e3-3fa9-418f-97e7-17dd016ae9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:25.757951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7937e3-3fa9-418f-97e7-17dd016ae9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:25.758695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7937e3-3fa9-418f-97e7-17dd016ae9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:25.760887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7937e3-3fa9-418f-97e7-17dd016ae9f2 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:25.860671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1027/2050] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:25 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:25.862044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9aa134-afe3-4bcb-b32b-33a5f779ad1f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:25.883192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9aa134-afe3-4bcb-b32b-33a5f779ad1f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:25.902375 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1fc9-510c-45af-b64b-3f668db26171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:25.905523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1fc9-510c-45af-b64b-3f668db26171 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:25.906043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1fc9-510c-45af-b64b-3f668db26171 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:25.906888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1fc9-510c-45af-b64b-3f668db26171 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:25.907934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a1fc9-510c-45af-b64b-3f668db26171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:25.909890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a1fc9-510c-45af-b64b-3f668db26171 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:25.933200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1024/2051] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:25.934240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7937e3-3fa9-418f-97e7-17dd016ae9f2 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:25.966773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7937e3-3fa9-418f-97e7-17dd016ae9f2 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:25.986210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b82eed-4a79-4cfd-b732-6b012ec9c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:25.987385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b82eed-4a79-4cfd-b732-6b012ec9c091 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:25.989184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b82eed-4a79-4cfd-b732-6b012ec9c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:25.989184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b82eed-4a79-4cfd-b732-6b012ec9c091 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:25.995046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b82eed-4a79-4cfd-b732-6b012ec9c091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:26.002065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b82eed-4a79-4cfd-b732-6b012ec9c091 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:26.025487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1fc9-510c-45af-b64b-3f668db26171 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:26.033617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1028/2052] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:55:26.039926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1fc9-510c-45af-b64b-3f668db26171 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:26.053998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:26.054959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:26.055232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:26.055514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] PATH_INFO: `/v3/projects/49392ed2b9424172b301e3627fdd346a/users/a89c3d142f014b13a6d1d1f2579b996e/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:26.109132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49392ed2b9424172b301e3627fdd346a, user_id=a89c3d142f014b13a6d1d1f2579b996e, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:26.113160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:26.249743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1025/2053] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:26 2022] PUT /identity/v3/projects/49392ed2b9424172b301e3627fdd346a/users/a89c3d142f014b13a6d1d1f2579b996e/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:55:26.266908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e825-8ac2-4324-896a-13e6971fb996 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:26.267631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e825-8ac2-4324-896a-13e6971fb996 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:26.268572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e825-8ac2-4324-896a-13e6971fb996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:26.330434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4714e825-8ac2-4324-896a-13e6971fb996 None None] MFA Rules not processed for user `a89c3d142f014b13a6d1d1f2579b996e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:26.332785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4714e825-8ac2-4324-896a-13e6971fb996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:26.467834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1029/2054] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:26.508626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:26.510529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:26.566605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:26.615175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c678c-164d-4aea-b2d3-aa6f747c584e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:26.619133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:26.619949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:26.620048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:26.620310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:26.632834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:26.634323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:26.645728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1026/2055] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:28.846088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714e825-8ac2-4324-896a-13e6971fb996 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:28.848057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4714e825-8ac2-4324-896a-13e6971fb996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:28.876562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:28.952440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714e825-8ac2-4324-896a-13e6971fb996 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:28.960333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:28.961467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:28.962137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:28.962550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] PATH_INFO: `/v3/users/9c4a937c0ec44f90af5be495ce3c5c4c` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:28.963962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4a937c0ec44f90af5be495ce3c5c4c)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:28.967666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:29.165002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4a937c0ec44f90af5be495ce3c5c4c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.225384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:29.227523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.262223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1eca-04ab-41c3-a5d8-77e7a6c4f6fb service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:29.273877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:29.275560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.275971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.276609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] PATH_INFO: `/v3/users/6f9ac923bb1b4c29874b2d71e99b0d2d` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.282204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9ac923bb1b4c29874b2d71e99b0d2d)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:29.283585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:29.340582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4a937c0ec44f90af5be495ce3c5c4c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.361792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4a937c0ec44f90af5be495ce3c5c4c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.369849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4a937c0ec44f90af5be495ce3c5c4c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.370644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d4492dd0-a5c6-48b4-b5a4-992790fc6a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4a937c0ec44f90af5be495ce3c5c4c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.377924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1030/2056] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:28 2022] DELETE /identity/v3/users/9c4a937c0ec44f90af5be495ce3c5c4c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:29.382553 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4707e-213e-4d25-936d-eb201731cd94 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.382842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4707e-213e-4d25-936d-eb201731cd94 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.383306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4707e-213e-4d25-936d-eb201731cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.402813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-65e4707e-213e-4d25-936d-eb201731cd94 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:29.404501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-65e4707e-213e-4d25-936d-eb201731cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.486666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1031/2057] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:29.513505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4707e-213e-4d25-936d-eb201731cd94 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:29.516331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-65e4707e-213e-4d25-936d-eb201731cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.524727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9ac923bb1b4c29874b2d71e99b0d2d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.591315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:29.591505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9ac923bb1b4c29874b2d71e99b0d2d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.615513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4707e-213e-4d25-936d-eb201731cd94 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:29.618956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9ac923bb1b4c29874b2d71e99b0d2d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.621142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9ac923bb1b4c29874b2d71e99b0d2d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.622174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:29.623201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.623973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.624452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.627554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.641708 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a35cfede-3e1e-49fc-a3e1-fb63ca584088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9ac923bb1b4c29874b2d71e99b0d2d'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:29.659598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:29.664547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:29.664673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1027/2058] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:29 2022] DELETE /identity/v3/users/6f9ac923bb1b4c29874b2d71e99b0d2d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:29.666719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f87c-c0d2-4154-8829-1b97d2550c6e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.667287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f87c-c0d2-4154-8829-1b97d2550c6e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.667746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f87c-c0d2-4154-8829-1b97d2550c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.677000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1032/2059] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:55:29.717265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9a00f87c-c0d2-4154-8829-1b97d2550c6e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:29.718636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9a00f87c-c0d2-4154-8829-1b97d2550c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.855652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1028/2060] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:29.867408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:29.872128 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.885830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb033c7e-5a45-4d29-bf97-bf30dba73b8b service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:29.945844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:29.946878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.947883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.948368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.962068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:29.963651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:29.976158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1033/2061] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:30.576746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f87c-c0d2-4154-8829-1b97d2550c6e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:30.580522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9a00f87c-c0d2-4154-8829-1b97d2550c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:30.610886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f87c-c0d2-4154-8829-1b97d2550c6e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:30.626941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:30.630578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:30.630578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:30.632252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] PATH_INFO: `/v3/projects/5df78336079f44d3af9cb58e006203e8` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:30.633821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df78336079f44d3af9cb58e006203e8)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:30.636973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:30.768613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:30.784779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df78336079f44d3af9cb58e006203e8', 'request_id': 'req-992283f3-71d4-42dd-ad26-a0c46895abea'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:30.801765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:30.804018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:30.818744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c38f8-c958-4440-af5c-80615ee45825 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:30.865640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df78336079f44d3af9cb58e006203e8', 'request_id': 'req-992283f3-71d4-42dd-ad26-a0c46895abea'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:30.872485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df78336079f44d3af9cb58e006203e8', 'request_id': 'req-992283f3-71d4-42dd-ad26-a0c46895abea'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:30.896921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:30.899911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:30.900218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:30.900507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] PATH_INFO: `/v3/projects/5717ab0b033a42e39390785e356742f4` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:30.900612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] The token cache is being invalidate because project 5df78336079f44d3af9cb58e006203e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:30.903423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:30.903423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-992283f3-71d4-42dd-ad26-a0c46895abea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:30.903686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5717ab0b033a42e39390785e356742f4)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:30.907642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:30.908592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1029/2062] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:30 2022] DELETE /identity/v3/projects/5df78336079f44d3af9cb58e006203e8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:30.910689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158b0b-9bd0-48cf-8ff7-858db47cee7f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:30.910984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158b0b-9bd0-48cf-8ff7-858db47cee7f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:30.911267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158b0b-9bd0-48cf-8ff7-858db47cee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:30.952821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-92158b0b-9bd0-48cf-8ff7-858db47cee7f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:30.955655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-92158b0b-9bd0-48cf-8ff7-858db47cee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:30.995355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1030/2063] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:31.009244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7894-3d3a-46c3-ab5f-30695d9ab99f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.009546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7894-3d3a-46c3-ab5f-30695d9ab99f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.009839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7894-3d3a-46c3-ab5f-30695d9ab99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.035173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ca2c7894-3d3a-46c3-ab5f-30695d9ab99f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:31.037008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ca2c7894-3d3a-46c3-ab5f-30695d9ab99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:31.054614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1031/2064] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:31.058595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7894-3d3a-46c3-ab5f-30695d9ab99f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.075399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7894-3d3a-46c3-ab5f-30695d9ab99f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.084657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.085363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.085905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.086173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.090080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:31.090312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.093511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:31.118643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5717ab0b033a42e39390785e356742f4', 'request_id': 'req-3203694c-2929-4706-ae52-55f5dc7f09ca'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:31.123415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1032/2065] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:31.124757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.152972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e322e-310c-4a6b-8c4d-cb89e99779ab admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.194074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5717ab0b033a42e39390785e356742f4', 'request_id': 'req-3203694c-2929-4706-ae52-55f5dc7f09ca'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:31.202702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5717ab0b033a42e39390785e356742f4', 'request_id': 'req-3203694c-2929-4706-ae52-55f5dc7f09ca'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:31.216113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] The token cache is being invalidate because project 5717ab0b033a42e39390785e356742f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:31.216718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:31.218047 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3203694c-2929-4706-ae52-55f5dc7f09ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:31.227581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1034/2066] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:30 2022] DELETE /identity/v3/projects/5717ab0b033a42e39390785e356742f4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:55:31.231487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea599f-b232-4e87-aef8-13b28e5cf084 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.232013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea599f-b232-4e87-aef8-13b28e5cf084 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.232529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea599f-b232-4e87-aef8-13b28e5cf084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.258270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-79ea599f-b232-4e87-aef8-13b28e5cf084 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:31.260884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-79ea599f-b232-4e87-aef8-13b28e5cf084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:31.273143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:31.288473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff7e9-99d0-414c-8486-c9f04a4553ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.288853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff7e9-99d0-414c-8486-c9f04a4553ca admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.289118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff7e9-99d0-414c-8486-c9f04a4553ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.289399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff7e9-99d0-414c-8486-c9f04a4553ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.290172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eff7e9-99d0-414c-8486-c9f04a4553ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.293006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eff7e9-99d0-414c-8486-c9f04a4553ca admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:31.349457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1035/2067] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:31.358206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e0ff-6915-45ef-a2f5-9a3082342bdb None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.358846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e0ff-6915-45ef-a2f5-9a3082342bdb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.359338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e0ff-6915-45ef-a2f5-9a3082342bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.387564 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1e61e0ff-6915-45ef-a2f5-9a3082342bdb None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:31.389416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1e61e0ff-6915-45ef-a2f5-9a3082342bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:31.407901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1033/2068] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:31 2022] POST /identity/v3/projects => generated 383 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:31.407901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff7e9-99d0-414c-8486-c9f04a4553ca admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.415807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1036/2069] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:31.416963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e0ff-6915-45ef-a2f5-9a3082342bdb None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.420118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1e61e0ff-6915-45ef-a2f5-9a3082342bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:31.443386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e0ff-6915-45ef-a2f5-9a3082342bdb None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.534751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb286-f634-48a0-80e0-95c5c3c14bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.538020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb286-f634-48a0-80e0-95c5c3c14bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.538494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb286-f634-48a0-80e0-95c5c3c14bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.538794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb286-f634-48a0-80e0-95c5c3c14bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.540531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eb286-f634-48a0-80e0-95c5c3c14bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.548900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eb286-f634-48a0-80e0-95c5c3c14bc1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:31.574059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff7e9-99d0-414c-8486-c9f04a4553ca admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.591505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.591505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.592185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.598234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.598234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:31.598234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.598234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:31.619125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1034/2070] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:31.623317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.643897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1037/2071] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:31 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:31.649803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb286-f634-48a0-80e0-95c5c3c14bc1 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.666608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5bcdc-8cd9-42fc-9892-9bacaf1358a1 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.682131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb286-f634-48a0-80e0-95c5c3c14bc1 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.685265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59adb4-70a7-42af-802b-5a128c25bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.685944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59adb4-70a7-42af-802b-5a128c25bfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.688046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59adb4-70a7-42af-802b-5a128c25bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.691339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59adb4-70a7-42af-802b-5a128c25bfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.692769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59adb4-70a7-42af-802b-5a128c25bfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.698526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59adb4-70a7-42af-802b-5a128c25bfc4 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:31.700967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132efbf7-c788-441c-a682-972a876e211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.700967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132efbf7-c788-441c-a682-972a876e211b admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.700967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132efbf7-c788-441c-a682-972a876e211b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.702028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132efbf7-c788-441c-a682-972a876e211b admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.702879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132efbf7-c788-441c-a682-972a876e211b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.708213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132efbf7-c788-441c-a682-972a876e211b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:31.727994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:31.739265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1038/2072] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:31.741162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132efbf7-c788-441c-a682-972a876e211b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.767437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132efbf7-c788-441c-a682-972a876e211b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.786021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e410c5c-0381-4819-b6f8-99d2dcd79adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.786920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e410c5c-0381-4819-b6f8-99d2dcd79adf admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.787216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e410c5c-0381-4819-b6f8-99d2dcd79adf admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.787504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e410c5c-0381-4819-b6f8-99d2dcd79adf admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.788257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e410c5c-0381-4819-b6f8-99d2dcd79adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.789884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e410c5c-0381-4819-b6f8-99d2dcd79adf admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:31.810879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1039/2073] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:55:31.813198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e410c5c-0381-4819-b6f8-99d2dcd79adf admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.824291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1035/2074] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:31 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:55:31.825779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59adb4-70a7-42af-802b-5a128c25bfc4 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:31.835659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e410c5c-0381-4819-b6f8-99d2dcd79adf admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.921168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59adb4-70a7-42af-802b-5a128c25bfc4 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:31.933828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f84f2-e933-42bd-93e8-3337332ae3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.934549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f84f2-e933-42bd-93e8-3337332ae3fd admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.934832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f84f2-e933-42bd-93e8-3337332ae3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.935122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f84f2-e933-42bd-93e8-3337332ae3fd admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.939329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f84f2-e933-42bd-93e8-3337332ae3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.946036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f84f2-e933-42bd-93e8-3337332ae3fd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:31.963816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd670526-fbc4-40b5-a840-ee80f688591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:31.973151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670526-fbc4-40b5-a840-ee80f688591b admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:31.973687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670526-fbc4-40b5-a840-ee80f688591b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:31.974701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670526-fbc4-40b5-a840-ee80f688591b admin admin] PATH_INFO: `/v3/projects/bce79e1212cc48eeb88b4c2e90c980a1/users/c1f43576ad9b47bd96ebc8ad58f9e85e/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:31.995449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd670526-fbc4-40b5-a840-ee80f688591b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce79e1212cc48eeb88b4c2e90c980a1, user_id=c1f43576ad9b47bd96ebc8ad58f9e85e, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:31.999351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd670526-fbc4-40b5-a840-ee80f688591b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:32.096127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1036/2075] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:31 2022] POST /identity/v3/users => generated 282 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:32.099754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f84f2-e933-42bd-93e8-3337332ae3fd admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:32.119423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f84f2-e933-42bd-93e8-3337332ae3fd admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:32.134913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12b10f-f51f-487c-be72-5cb227fe66c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:32.136087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12b10f-f51f-487c-be72-5cb227fe66c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:32.136589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12b10f-f51f-487c-be72-5cb227fe66c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:32.137120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12b10f-f51f-487c-be72-5cb227fe66c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:32.138085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12b10f-f51f-487c-be72-5cb227fe66c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:32.141721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12b10f-f51f-487c-be72-5cb227fe66c5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:32.163934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1037/2077] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:55:32.164623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1040/2077] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:31 2022] PUT /identity/v3/projects/bce79e1212cc48eeb88b4c2e90c980a1/users/c1f43576ad9b47bd96ebc8ad58f9e85e/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:55:32.168714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9f35-70dc-43c1-9c85-e6682c6aaea9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:32.169294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9f35-70dc-43c1-9c85-e6682c6aaea9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:32.170320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9f35-70dc-43c1-9c85-e6682c6aaea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:32.174944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12b10f-f51f-487c-be72-5cb227fe66c5 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:32.212814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12b10f-f51f-487c-be72-5cb227fe66c5 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:32.244316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-194a9f35-70dc-43c1-9c85-e6682c6aaea9 None None] MFA Rules not processed for user `c1f43576ad9b47bd96ebc8ad58f9e85e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:32.249431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-194a9f35-70dc-43c1-9c85-e6682c6aaea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:32.356283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:32.357020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:32.357375 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:32.357720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:32.358558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:32.360245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:32.391548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1041/2078] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:32.391648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1038/2079] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:32.394809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9f35-70dc-43c1-9c85-e6682c6aaea9 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:32.407946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:32.408379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9f35-70dc-43c1-9c85-e6682c6aaea9 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:32.409965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:32.426288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9f693-d919-48de-bad8-0e0486d0b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:32.428861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9f693-d919-48de-bad8-0e0486d0b8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:32.429372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9f693-d919-48de-bad8-0e0486d0b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:32.429840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9f693-d919-48de-bad8-0e0486d0b8f1 admin admin] PATH_INFO: `/v3/projects/8ca47cdc40de45898c2a360302fd6ea6/users/0c0a5c8de12349f2949cf2fc549e2336/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:32.482588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2bb4-7684-43c8-a213-964e9f4c8a2e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:32.484844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9f693-d919-48de-bad8-0e0486d0b8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca47cdc40de45898c2a360302fd6ea6, user_id=0c0a5c8de12349f2949cf2fc549e2336, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:32.487603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84741887-d4ce-462e-a887-cc8a16ee2bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:32.488915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741887-d4ce-462e-a887-cc8a16ee2bdb service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:32.489266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741887-d4ce-462e-a887-cc8a16ee2bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:32.489610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741887-d4ce-462e-a887-cc8a16ee2bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:32.496141 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9f693-d919-48de-bad8-0e0486d0b8f1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:32.501997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84741887-d4ce-462e-a887-cc8a16ee2bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:32.504680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84741887-d4ce-462e-a887-cc8a16ee2bdb service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:32.516717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1039/2080] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:32.631001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1042/2081] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:32 2022] PUT /identity/v3/projects/8ca47cdc40de45898c2a360302fd6ea6/users/0c0a5c8de12349f2949cf2fc549e2336/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:32.652012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d370a-c97b-485f-a6fc-ea9a80f6adec None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:32.652548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d370a-c97b-485f-a6fc-ea9a80f6adec None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:32.652548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d370a-c97b-485f-a6fc-ea9a80f6adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:32.706159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-cc9d370a-c97b-485f-a6fc-ea9a80f6adec None None] MFA Rules not processed for user `0c0a5c8de12349f2949cf2fc549e2336`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:32.707962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cc9d370a-c97b-485f-a6fc-ea9a80f6adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:32.855237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1040/2082] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:32.885442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9f693-d919-48de-bad8-0e0486d0b8f1 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:32.954069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:33.006446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9f693-d919-48de-bad8-0e0486d0b8f1 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:33.015988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb30d4-a18c-467c-8990-65befe58a7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:33.016710 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb30d4-a18c-467c-8990-65befe58a7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:33.016998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb30d4-a18c-467c-8990-65befe58a7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:33.017521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb30d4-a18c-467c-8990-65befe58a7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:33.054947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb30d4-a18c-467c-8990-65befe58a7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:33.057004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb30d4-a18c-467c-8990-65befe58a7a9 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:33.070018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1043/2083] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:33.483526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:42.085836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d370a-c97b-485f-a6fc-ea9a80f6adec None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:42.088383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cc9d370a-c97b-485f-a6fc-ea9a80f6adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:42.197172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d370a-c97b-485f-a6fc-ea9a80f6adec None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:42.210020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:42.211372 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:42.212355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:42.212881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] PATH_INFO: `/v3/users/45f7ce866642483b809d9d7bd541aa6a` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:42.214431 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f7ce866642483b809d9d7bd541aa6a)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:42.218878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:42.500240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f7ce866642483b809d9d7bd541aa6a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:42.563759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f7ce866642483b809d9d7bd541aa6a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:42.600093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f7ce866642483b809d9d7bd541aa6a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:42.603115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f7ce866642483b809d9d7bd541aa6a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:42.620245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f7ce866642483b809d9d7bd541aa6a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:42.631883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1041/2084] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:42 2022] DELETE /identity/v3/users/45f7ce866642483b809d9d7bd541aa6a => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:42.636086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846cb0-a359-4529-8611-07464eb5cd03 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:42.636584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846cb0-a359-4529-8611-07464eb5cd03 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:42.636669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846cb0-a359-4529-8611-07464eb5cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:42.666152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c9846cb0-a359-4529-8611-07464eb5cd03 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:42.666152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c9846cb0-a359-4529-8611-07464eb5cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:42.762499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1044/2085] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:42.788781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:42.790282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:42.833941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:42.908173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658347f-75f0-4d39-89aa-490841a0af06 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:42.916958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394359cf-abc1-489f-9afc-1e93302219ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:42.917746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394359cf-abc1-489f-9afc-1e93302219ac service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:42.918085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394359cf-abc1-489f-9afc-1e93302219ac service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:42.918560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394359cf-abc1-489f-9afc-1e93302219ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:42.939328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394359cf-abc1-489f-9afc-1e93302219ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:42.942417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394359cf-abc1-489f-9afc-1e93302219ac service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:42.963695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1042/2086] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:44.281581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9846cb0-a359-4529-8611-07464eb5cd03 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:44.283131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c9846cb0-a359-4529-8611-07464eb5cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:44.295930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9846cb0-a359-4529-8611-07464eb5cd03 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:44.313630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:44.315773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:44.316126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:44.316415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] PATH_INFO: `/v3/projects/f7d619deb6fa4cdeb49ee613957d6a6f` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:44.320227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d619deb6fa4cdeb49ee613957d6a6f)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:44.320686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:44.322699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:44.463252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d619deb6fa4cdeb49ee613957d6a6f', 'request_id': 'req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:44.539685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d619deb6fa4cdeb49ee613957d6a6f', 'request_id': 'req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:44.548232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d619deb6fa4cdeb49ee613957d6a6f', 'request_id': 'req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:44.560894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] The token cache is being invalidate because project f7d619deb6fa4cdeb49ee613957d6a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:44.561275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:44.563869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c2fbc3ea-0e3a-42d8-a46d-f14f8d7fa23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:44.565514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1045/2087] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:44 2022] DELETE /identity/v3/projects/f7d619deb6fa4cdeb49ee613957d6a6f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:44.570930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214f46-efb7-4bad-b93e-749459eafc5d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:44.571981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214f46-efb7-4bad-b93e-749459eafc5d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:44.572445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214f46-efb7-4bad-b93e-749459eafc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:44.592676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-59214f46-efb7-4bad-b93e-749459eafc5d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:44.593914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-59214f46-efb7-4bad-b93e-749459eafc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:44.666495 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1043/2088] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:44.674251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e6f9-f76d-4d75-b895-fe9a60d0d8f0 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:44.674594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e6f9-f76d-4d75-b895-fe9a60d0d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:44.675069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e6f9-f76d-4d75-b895-fe9a60d0d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:44.697087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-8ea1e6f9-f76d-4d75-b895-fe9a60d0d8f0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:44.698397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8ea1e6f9-f76d-4d75-b895-fe9a60d0d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:44.711881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1046/2089] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:44.713507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59214f46-efb7-4bad-b93e-749459eafc5d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:44.726465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59214f46-efb7-4bad-b93e-749459eafc5d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:44.732421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:44.733091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:44.733376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:44.733654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:44.734423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:44.734928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:44.736628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:44.771252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1044/2090] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:44.776660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1e6f9-f76d-4d75-b895-fe9a60d0d8f0 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:44.788588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1e6f9-f76d-4d75-b895-fe9a60d0d8f0 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:44.794093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58122fdf-44fe-4372-8066-2dfd328282ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:44.801845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58122fdf-44fe-4372-8066-2dfd328282ab admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:44.801845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58122fdf-44fe-4372-8066-2dfd328282ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:44.801845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58122fdf-44fe-4372-8066-2dfd328282ab admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:44.801845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58122fdf-44fe-4372-8066-2dfd328282ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:44.801845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58122fdf-44fe-4372-8066-2dfd328282ab admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:44.953368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1047/2091] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:44 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:44.958010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:44.968480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e91002-591d-44a5-90bd-3d030771390a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:45.038598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2f806-7bfb-4984-aacc-086532e0e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:45.039294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2f806-7bfb-4984-aacc-086532e0e885 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:45.039576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2f806-7bfb-4984-aacc-086532e0e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:45.039917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2f806-7bfb-4984-aacc-086532e0e885 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:45.040612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2f806-7bfb-4984-aacc-086532e0e885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:45.042666 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2f806-7bfb-4984-aacc-086532e0e885 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:45.153570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1045/2092] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:44 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:45.157757 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58122fdf-44fe-4372-8066-2dfd328282ab admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:45.178062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58122fdf-44fe-4372-8066-2dfd328282ab admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:45.184140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884462-79f9-4f99-92eb-eda1a2535f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:45.184938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884462-79f9-4f99-92eb-eda1a2535f1f admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:45.185980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884462-79f9-4f99-92eb-eda1a2535f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:45.186388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884462-79f9-4f99-92eb-eda1a2535f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:45.187653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd884462-79f9-4f99-92eb-eda1a2535f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:45.189470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd884462-79f9-4f99-92eb-eda1a2535f1f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:45.227680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1048/2093] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:45.232701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2f806-7bfb-4984-aacc-086532e0e885 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:45.254575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2f806-7bfb-4984-aacc-086532e0e885 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:45.263277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4c28a-09c3-43ab-8469-1f1c363140cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:45.264312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c28a-09c3-43ab-8469-1f1c363140cf admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:45.264807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c28a-09c3-43ab-8469-1f1c363140cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:45.265341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c28a-09c3-43ab-8469-1f1c363140cf admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:45.266494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c28a-09c3-43ab-8469-1f1c363140cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:45.270237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c28a-09c3-43ab-8469-1f1c363140cf admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:45.290952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1046/2094] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:55:45.296444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884462-79f9-4f99-92eb-eda1a2535f1f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:45.310997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884462-79f9-4f99-92eb-eda1a2535f1f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:45.320413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:45.321667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:45.322172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:45.322609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] PATH_INFO: `/v3/projects/3d7ae010f6c04f81a624e9bb36eacaff/users/9dd1ddd1593e4269b93f0df1d42e6964/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:45.350145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7ae010f6c04f81a624e9bb36eacaff, user_id=9dd1ddd1593e4269b93f0df1d42e6964, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:45.355596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:45.456383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1049/2095] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:45 2022] PUT /identity/v3/projects/3d7ae010f6c04f81a624e9bb36eacaff/users/9dd1ddd1593e4269b93f0df1d42e6964/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:45.469643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2b03-8e1b-42cd-abf1-6d2a898f0efc None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:45.469643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2b03-8e1b-42cd-abf1-6d2a898f0efc None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:45.469990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2b03-8e1b-42cd-abf1-6d2a898f0efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:45.538426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-881b2b03-8e1b-42cd-abf1-6d2a898f0efc None None] MFA Rules not processed for user `9dd1ddd1593e4269b93f0df1d42e6964`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:45.540329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-881b2b03-8e1b-42cd-abf1-6d2a898f0efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:45.569727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:45.657990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1047/2096] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:45.710527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:45.713686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:45.818418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214840-7e86-4379-8fdd-15b86770c7d9 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:45.823461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702960-9761-4edd-b4f7-3247fec8325d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:45.823714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702960-9761-4edd-b4f7-3247fec8325d service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:45.824084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702960-9761-4edd-b4f7-3247fec8325d service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:45.824638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702960-9761-4edd-b4f7-3247fec8325d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:45.837992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702960-9761-4edd-b4f7-3247fec8325d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:45.839533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702960-9761-4edd-b4f7-3247fec8325d service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:45.852199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1050/2097] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:45.911736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2b03-8e1b-42cd-abf1-6d2a898f0efc None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:46.050094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2b03-8e1b-42cd-abf1-6d2a898f0efc None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:46.056316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:46.057308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:46.057590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:46.057869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] PATH_INFO: `/v3/users/9dd1ddd1593e4269b93f0df1d42e6964` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:46.059451 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd1ddd1593e4269b93f0df1d42e6964)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:46.062193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:46.332477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd1ddd1593e4269b93f0df1d42e6964'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:46.404882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd1ddd1593e4269b93f0df1d42e6964'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:46.424480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd1ddd1593e4269b93f0df1d42e6964'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:46.426156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd1ddd1593e4269b93f0df1d42e6964'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:46.440790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd1ddd1593e4269b93f0df1d42e6964'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:46.456928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1048/2098] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:45 2022] DELETE /identity/v3/users/9dd1ddd1593e4269b93f0df1d42e6964 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:46.461785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71e4c-d685-4987-8c79-64ab9565239f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:46.467380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71e4c-d685-4987-8c79-64ab9565239f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:46.467380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71e4c-d685-4987-8c79-64ab9565239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:46.484207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9df71e4c-d685-4987-8c79-64ab9565239f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:46.486348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9df71e4c-d685-4987-8c79-64ab9565239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:46.520731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:46.584588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1051/2099] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:46.617565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:46.623398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:46.696653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:46.746459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ef0a6-5807-443b-8373-344e6d888905 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:46.751448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:46.752552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:46.753288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:46.753818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:46.784359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:46.787034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:46.803811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1049/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:47.383329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df71e4c-d685-4987-8c79-64ab9565239f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:47.385045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9df71e4c-d685-4987-8c79-64ab9565239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:47.512735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df71e4c-d685-4987-8c79-64ab9565239f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:47.519889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:47.520874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:47.521387 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:47.521957 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:47.524183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:47.539133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:47.541389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:47.554827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1052/2101] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:47.674884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:47.677676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:47.721197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713f84-602b-4fbf-90dd-5800c0ef8dcd service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:47.730838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:47.732103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:47.732618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:47.733092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] PATH_INFO: `/v3/projects/3d7ae010f6c04f81a624e9bb36eacaff` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:47.736734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7ae010f6c04f81a624e9bb36eacaff)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:47.740097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:47.928891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7ae010f6c04f81a624e9bb36eacaff', 'request_id': 'req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:48.002083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7ae010f6c04f81a624e9bb36eacaff', 'request_id': 'req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:48.018143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7ae010f6c04f81a624e9bb36eacaff', 'request_id': 'req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:48.052542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] The token cache is being invalidate because project 3d7ae010f6c04f81a624e9bb36eacaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:48.052898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:48.055769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8afe0d89-dbe7-45a4-a908-08646d1d1bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:48.058125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1050/2102] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:47 2022] DELETE /identity/v3/projects/3d7ae010f6c04f81a624e9bb36eacaff => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:56.556336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:56.558726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:56.582984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f3be-497a-48a9-ac36-0defdf5c91c1 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:56.685748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:56.686801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:56.687182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:56.687559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] PATH_INFO: `/v3/users/86ab14c9cee248ba92376a6ea247b08b` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:56.689988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ab14c9cee248ba92376a6ea247b08b)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:56.693657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:56.917136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ab14c9cee248ba92376a6ea247b08b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:56.984393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ab14c9cee248ba92376a6ea247b08b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:56.992324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:57.009381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ab14c9cee248ba92376a6ea247b08b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:57.027152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ab14c9cee248ba92376a6ea247b08b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:57.027915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ab14c9cee248ba92376a6ea247b08b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:57.038467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1053/2103] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:56 2022] DELETE /identity/v3/users/86ab14c9cee248ba92376a6ea247b08b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:57.040254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52833-3fc5-4196-b9ca-d85cdfb2a358 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:57.040750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52833-3fc5-4196-b9ca-d85cdfb2a358 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:57.040869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52833-3fc5-4196-b9ca-d85cdfb2a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:57.073933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-6fa52833-3fc5-4196-b9ca-d85cdfb2a358 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:57.076159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6fa52833-3fc5-4196-b9ca-d85cdfb2a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:57.196423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1051/2104] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:57.238565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:57.240853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:57.362686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27defc2c-d216-4049-839b-01efcb0e71be admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:57.366827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cecfe-0452-44cc-b02e-7ed7f4a1ddb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:57.378791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cecfe-0452-44cc-b02e-7ed7f4a1ddb8 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:57.378791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cecfe-0452-44cc-b02e-7ed7f4a1ddb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:57.378791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cecfe-0452-44cc-b02e-7ed7f4a1ddb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:57.382657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cecfe-0452-44cc-b02e-7ed7f4a1ddb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:57.384524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cecfe-0452-44cc-b02e-7ed7f4a1ddb8 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:57.398223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1054/2105] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:55:58.773835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa52833-3fc5-4196-b9ca-d85cdfb2a358 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:58.777909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6fa52833-3fc5-4196-b9ca-d85cdfb2a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:58.796981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa52833-3fc5-4196-b9ca-d85cdfb2a358 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:58.806376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:58.807758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:58.808319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:58.809153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] PATH_INFO: `/v3/projects/99043c18ce7945a8956a4d6c3c4ad57b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:58.810741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99043c18ce7945a8956a4d6c3c4ad57b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:58.814945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:58.981663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99043c18ce7945a8956a4d6c3c4ad57b', 'request_id': 'req-b6450080-67a7-4abc-bdb5-723b61b38cf6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:58.989262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:59.041655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99043c18ce7945a8956a4d6c3c4ad57b', 'request_id': 'req-b6450080-67a7-4abc-bdb5-723b61b38cf6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.052623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99043c18ce7945a8956a4d6c3c4ad57b', 'request_id': 'req-b6450080-67a7-4abc-bdb5-723b61b38cf6'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.083667 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] The token cache is being invalidate because project 99043c18ce7945a8956a4d6c3c4ad57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:59.084132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.085045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.089608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1052/2106] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:58 2022] DELETE /identity/v3/projects/99043c18ce7945a8956a4d6c3c4ad57b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:55:59.091218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cecfe-0452-44cc-b02e-7ed7f4a1ddb8 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:59.107264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cecfe-0452-44cc-b02e-7ed7f4a1ddb8 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:59.207055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:59.207055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:59.207055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:59.207055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] PATH_INFO: `/v3/users/3f3c7449b7b44ee193d8ef27c3f9a1a8` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:59.207462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3c7449b7b44ee193d8ef27c3f9a1a8)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:59.208696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:59.466655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3c7449b7b44ee193d8ef27c3f9a1a8'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.590565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3c7449b7b44ee193d8ef27c3f9a1a8'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.620079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3c7449b7b44ee193d8ef27c3f9a1a8'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.636910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3c7449b7b44ee193d8ef27c3f9a1a8'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.639403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7f6a5647-0a45-4f5d-8494-9919e12f972c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3c7449b7b44ee193d8ef27c3f9a1a8'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:59.644195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:59.653992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1055/2107] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:59 2022] DELETE /identity/v3/users/3f3c7449b7b44ee193d8ef27c3f9a1a8 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:01.262628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:01.264203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:01.286676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450080-67a7-4abc-bdb5-723b61b38cf6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:01.446243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:01.447949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.448415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.448852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] PATH_INFO: `/v3/projects/029ef5a6bee9445ca13638f5de2d90bc` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.450510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=029ef5a6bee9445ca13638f5de2d90bc)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:01.453027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:01.635204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029ef5a6bee9445ca13638f5de2d90bc', 'request_id': 'req-39ea2c42-f09d-496c-bf2e-241144885b4a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:01.725592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029ef5a6bee9445ca13638f5de2d90bc', 'request_id': 'req-39ea2c42-f09d-496c-bf2e-241144885b4a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:01.744228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029ef5a6bee9445ca13638f5de2d90bc', 'request_id': 'req-39ea2c42-f09d-496c-bf2e-241144885b4a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:01.803275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] The token cache is being invalidate because project 029ef5a6bee9445ca13638f5de2d90bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:01.803756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:01.805813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-39ea2c42-f09d-496c-bf2e-241144885b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:01.810847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1053/2108] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:01 2022] DELETE /identity/v3/projects/029ef5a6bee9445ca13638f5de2d90bc => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:01.817085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c5a6a-bd93-43ed-adee-10f236922305 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.817605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c5a6a-bd93-43ed-adee-10f236922305 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.817714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c5a6a-bd93-43ed-adee-10f236922305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.863620 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9b9c5a6a-bd93-43ed-adee-10f236922305 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:01.865329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9b9c5a6a-bd93-43ed-adee-10f236922305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:01.960768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a7d3-011f-4999-ad9c-ac989da02eff None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.961120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a7d3-011f-4999-ad9c-ac989da02eff None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.961991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a7d3-011f-4999-ad9c-ac989da02eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.973101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1056/2109] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:01.988231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-be93a7d3-011f-4999-ad9c-ac989da02eff None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:02.001224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-be93a7d3-011f-4999-ad9c-ac989da02eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:02.025878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c5a6a-bd93-43ed-adee-10f236922305 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.042560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1054/2110] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:02.042723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c5a6a-bd93-43ed-adee-10f236922305 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.053738 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.054958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.055318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.055687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.061992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:02.061992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.063529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.083069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1057/2111] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:56:02.087180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a7d3-011f-4999-ad9c-ac989da02eff None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.103335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a7d3-011f-4999-ad9c-ac989da02eff None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.123280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.136946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.137190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.137486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.138290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.141004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.284913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.286197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1055/2112] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:02 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:02.304967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53da64-8e74-475e-bda5-ac4ce6cd39f1 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.432759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe3057-e582-4d4b-b735-2916d9d7cbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.433731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe3057-e582-4d4b-b735-2916d9d7cbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.434073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe3057-e582-4d4b-b735-2916d9d7cbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.434395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe3057-e582-4d4b-b735-2916d9d7cbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.435350 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe3057-e582-4d4b-b735-2916d9d7cbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.440145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe3057-e582-4d4b-b735-2916d9d7cbd2 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.555858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1058/2113] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:02 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:02.561671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe3057-e582-4d4b-b735-2916d9d7cbd2 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.561852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.563447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:02.578893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe3057-e582-4d4b-b735-2916d9d7cbd2 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.588855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17376794-1552-4762-abf7-7693d109619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.590923 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376794-1552-4762-abf7-7693d109619f admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.591346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376794-1552-4762-abf7-7693d109619f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.591667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376794-1552-4762-abf7-7693d109619f admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.592764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17376794-1552-4762-abf7-7693d109619f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.599227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17376794-1552-4762-abf7-7693d109619f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.604317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8795547-5b97-4cce-8964-3e844880c38a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.613309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.614814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.615466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1059/2114] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:02.616455 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.616965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] PATH_INFO: `/v3/users/c1f43576ad9b47bd96ebc8ad58f9e85e` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.619901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f43576ad9b47bd96ebc8ad58f9e85e)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.620166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17376794-1552-4762-abf7-7693d109619f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.622498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.643183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17376794-1552-4762-abf7-7693d109619f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.649611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378c209-567f-45bf-8067-08454fda3937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.651260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378c209-567f-45bf-8067-08454fda3937 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.651578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378c209-567f-45bf-8067-08454fda3937 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.651854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378c209-567f-45bf-8067-08454fda3937 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.652680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378c209-567f-45bf-8067-08454fda3937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.654397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378c209-567f-45bf-8067-08454fda3937 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.669701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1060/2115] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:02.677027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378c209-567f-45bf-8067-08454fda3937 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.694279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378c209-567f-45bf-8067-08454fda3937 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.700819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce98385-1ac6-4f91-8a4c-28be34f26525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.702834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98385-1ac6-4f91-8a4c-28be34f26525 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.703130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98385-1ac6-4f91-8a4c-28be34f26525 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.703422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98385-1ac6-4f91-8a4c-28be34f26525 admin admin] PATH_INFO: `/v3/projects/1a9d115a02004f7dbb3ce63bd2e38a5d/users/59a82ad0659d4a179b9c1291a1c8a37f/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.729363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce98385-1ac6-4f91-8a4c-28be34f26525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9d115a02004f7dbb3ce63bd2e38a5d, user_id=59a82ad0659d4a179b9c1291a1c8a37f, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.734473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce98385-1ac6-4f91-8a4c-28be34f26525 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.819986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1061/2116] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:02 2022] PUT /identity/v3/projects/1a9d115a02004f7dbb3ce63bd2e38a5d/users/59a82ad0659d4a179b9c1291a1c8a37f/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:02.829790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f400e0c-d8cb-4a78-a13e-81e2549714e6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.830087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f400e0c-d8cb-4a78-a13e-81e2549714e6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.830470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f400e0c-d8cb-4a78-a13e-81e2549714e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.856312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:02.875280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f43576ad9b47bd96ebc8ad58f9e85e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:02.884246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9f400e0c-d8cb-4a78-a13e-81e2549714e6 None None] MFA Rules not processed for user `59a82ad0659d4a179b9c1291a1c8a37f`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:02.885536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9f400e0c-d8cb-4a78-a13e-81e2549714e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:02.906372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:02.962475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1062/2117] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:02.966449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f400e0c-d8cb-4a78-a13e-81e2549714e6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.981685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f43576ad9b47bd96ebc8ad58f9e85e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:03.030410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f43576ad9b47bd96ebc8ad58f9e85e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:03.035412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f43576ad9b47bd96ebc8ad58f9e85e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:03.060624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9b5560b8-d872-42f4-b5f4-7bccee94c6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f43576ad9b47bd96ebc8ad58f9e85e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:03.083842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f400e0c-d8cb-4a78-a13e-81e2549714e6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:03.084207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1056/2118] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:02 2022] DELETE /identity/v3/users/c1f43576ad9b47bd96ebc8ad58f9e85e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:03.093566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6960-6d7a-4f72-81d9-1948ea487c81 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:03.094252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6960-6d7a-4f72-81d9-1948ea487c81 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:03.095204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6960-6d7a-4f72-81d9-1948ea487c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:03.160956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-34df6960-6d7a-4f72-81d9-1948ea487c81 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:03.164351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-34df6960-6d7a-4f72-81d9-1948ea487c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:03.229209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:03.229898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:03.230269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:03.230484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:03.231187 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:03.233120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:03.284799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1057/2119] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:03.309392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df6960-6d7a-4f72-81d9-1948ea487c81 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:03.311939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-34df6960-6d7a-4f72-81d9-1948ea487c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:03.382209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1063/2120] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:02 2022] POST /identity/v3/projects => generated 363 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:03.388073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:03.394505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:03.428821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df6960-6d7a-4f72-81d9-1948ea487c81 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:03.538285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e71a9c-d6cf-4e7d-9255-449e770a90c6 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:03.549407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438ecf5-3f2d-4b23-ad25-70755e1581c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:03.549654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:03.550287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:03.550576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:03.550854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:03.552206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:03.552780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438ecf5-3f2d-4b23-ad25-70755e1581c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:03.553088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438ecf5-3f2d-4b23-ad25-70755e1581c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:03.554252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438ecf5-3f2d-4b23-ad25-70755e1581c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:03.554983 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438ecf5-3f2d-4b23-ad25-70755e1581c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:03.556996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438ecf5-3f2d-4b23-ad25-70755e1581c9 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:03.575345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:03.578730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:03.591070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1058/2121] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:03.649210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:03.650534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:03.673889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe8b33-24f7-45d1-87dc-13694c656a1e service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:03.684198 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:03.685483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:03.686155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:03.686603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] PATH_INFO: `/v3/users/d079c09918a649d88b2afa2a2ed44a3c` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:03.689370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d079c09918a649d88b2afa2a2ed44a3c)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:03.697154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1064/2122] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:03 2022] POST /identity/v3/users => generated 288 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:03.698577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438ecf5-3f2d-4b23-ad25-70755e1581c9 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:03.699712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:03.712014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438ecf5-3f2d-4b23-ad25-70755e1581c9 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:03.720371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823fc8-12ac-49a8-9f3a-187e9edbf07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:03.720371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823fc8-12ac-49a8-9f3a-187e9edbf07c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:03.720371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823fc8-12ac-49a8-9f3a-187e9edbf07c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:03.720371 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823fc8-12ac-49a8-9f3a-187e9edbf07c admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:03.721235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01823fc8-12ac-49a8-9f3a-187e9edbf07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:03.724603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01823fc8-12ac-49a8-9f3a-187e9edbf07c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:03.750938 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1065/2123] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:03.756417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823fc8-12ac-49a8-9f3a-187e9edbf07c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:03.772697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823fc8-12ac-49a8-9f3a-187e9edbf07c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:03.780193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e8330-6260-4aaf-8b5b-d23989fe23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:03.781597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8330-6260-4aaf-8b5b-d23989fe23c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:03.781970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8330-6260-4aaf-8b5b-d23989fe23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:03.782345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8330-6260-4aaf-8b5b-d23989fe23c1 admin admin] PATH_INFO: `/v3/projects/baab73727cf2484d8303b02f6901a72a/users/01e3e30fc2044db9b2d54788a17da84e/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:03.812568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e8330-6260-4aaf-8b5b-d23989fe23c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baab73727cf2484d8303b02f6901a72a, user_id=01e3e30fc2044db9b2d54788a17da84e, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:03.821397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e8330-6260-4aaf-8b5b-d23989fe23c1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:03.877585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:03.912013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1066/2124] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:03 2022] PUT /identity/v3/projects/baab73727cf2484d8303b02f6901a72a/users/01e3e30fc2044db9b2d54788a17da84e/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:03.915956 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd079c09918a649d88b2afa2a2ed44a3c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:03.916207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e8330-6260-4aaf-8b5b-d23989fe23c1 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:03.999020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd079c09918a649d88b2afa2a2ed44a3c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.020670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd079c09918a649d88b2afa2a2ed44a3c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.022203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd079c09918a649d88b2afa2a2ed44a3c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.038797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd079c09918a649d88b2afa2a2ed44a3c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.050904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1059/2125] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:03 2022] DELETE /identity/v3/users/d079c09918a649d88b2afa2a2ed44a3c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:04.081811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e8330-6260-4aaf-8b5b-d23989fe23c1 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:04.240470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:04.245015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:04.245868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:04.246202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:04.247275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:04.249171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:04.272563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:04.274872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.288345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1067/2126] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:04.294674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:04.298677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.302554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bd466-9a53-4565-a62c-364fc704c8cc admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:04.328050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:04.335336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddbdb3-b625-4d8e-916f-a0c9577c60bc admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:04.335886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:04.336532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:04.342235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a991358-6694-48c3-975a-b84f2fe7cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:04.343267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991358-6694-48c3-975a-b84f2fe7cfcf admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:04.343839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] PATH_INFO: `/v3/projects/bce79e1212cc48eeb88b4c2e90c980a1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:04.344281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991358-6694-48c3-975a-b84f2fe7cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:04.344645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991358-6694-48c3-975a-b84f2fe7cfcf admin admin] PATH_INFO: `/v3/projects/baab73727cf2484d8303b02f6901a72a/users/01e3e30fc2044db9b2d54788a17da84e/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:04.345986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce79e1212cc48eeb88b4c2e90c980a1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:04.349226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:04.350176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a991358-6694-48c3-975a-b84f2fe7cfcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=baab73727cf2484d8303b02f6901a72a, user_id=01e3e30fc2044db9b2d54788a17da84e, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:04.355979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a991358-6694-48c3-975a-b84f2fe7cfcf admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:04.387410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1068/2127] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:04 2022] PUT /identity/v3/projects/baab73727cf2484d8303b02f6901a72a/users/01e3e30fc2044db9b2d54788a17da84e/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:04.399554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706fe4-91d7-4327-b373-756bcf190737 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:04.399847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706fe4-91d7-4327-b373-756bcf190737 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:04.400131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706fe4-91d7-4327-b373-756bcf190737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:04.461796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-2e706fe4-91d7-4327-b373-756bcf190737 None None] MFA Rules not processed for user `01e3e30fc2044db9b2d54788a17da84e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:04.463145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2e706fe4-91d7-4327-b373-756bcf190737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.520529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:04.531071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce79e1212cc48eeb88b4c2e90c980a1', 'request_id': 'req-afb66582-80cf-47a5-8a78-a0caf79ce6e9'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.601915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce79e1212cc48eeb88b4c2e90c980a1', 'request_id': 'req-afb66582-80cf-47a5-8a78-a0caf79ce6e9'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.608777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce79e1212cc48eeb88b4c2e90c980a1', 'request_id': 'req-afb66582-80cf-47a5-8a78-a0caf79ce6e9'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.631660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] The token cache is being invalidate because project bce79e1212cc48eeb88b4c2e90c980a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:04.632775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.635163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-afb66582-80cf-47a5-8a78-a0caf79ce6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:04.640282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1060/2128] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:04 2022] DELETE /identity/v3/projects/bce79e1212cc48eeb88b4c2e90c980a1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:04.642157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1069/2129] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:04.652186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9faf1-08db-4118-8973-ed987949d0f7 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:04.655882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9faf1-08db-4118-8973-ed987949d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:04.655882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9faf1-08db-4118-8973-ed987949d0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:04.671950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706fe4-91d7-4327-b373-756bcf190737 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:04.674192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2e706fe4-91d7-4327-b373-756bcf190737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.702581 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-54e9faf1-08db-4118-8973-ed987949d0f7 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:04.711808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-54e9faf1-08db-4118-8973-ed987949d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.842715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706fe4-91d7-4327-b373-756bcf190737 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:04.896120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1061/2130] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:04.896120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9faf1-08db-4118-8973-ed987949d0f7 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:04.900345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-54e9faf1-08db-4118-8973-ed987949d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.913049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7a23-8acf-4910-9a56-bb4a3ebd6925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:04.915538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7a23-8acf-4910-9a56-bb4a3ebd6925 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:04.915843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7a23-8acf-4910-9a56-bb4a3ebd6925 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:04.916127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7a23-8acf-4910-9a56-bb4a3ebd6925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:04.918463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9faf1-08db-4118-8973-ed987949d0f7 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:04.918855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7b8e7a23-8acf-4910-9a56-bb4a3ebd6925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.931462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:04.936814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:04.937397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:04.937836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] PATH_INFO: `/v3/projects/cddfcba5ecec46fc8638d3fd2192fd69` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:04.939817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cddfcba5ecec46fc8638d3fd2192fd69)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:04.942783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:04.961177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:05.000025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7a23-8acf-4910-9a56-bb4a3ebd6925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.001484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7a23-8acf-4910-9a56-bb4a3ebd6925 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.014715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1070/2131] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:05.016030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb0da-a0a5-4cfd-9290-8dcc7a12c9c9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.016324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb0da-a0a5-4cfd-9290-8dcc7a12c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.016643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb0da-a0a5-4cfd-9290-8dcc7a12c9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.039114 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-a82cb0da-a0a5-4cfd-9290-8dcc7a12c9c9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:05.041313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a82cb0da-a0a5-4cfd-9290-8dcc7a12c9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:05.051979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1071/2132] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:05.056211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cb0da-a0a5-4cfd-9290-8dcc7a12c9c9 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.073659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cb0da-a0a5-4cfd-9290-8dcc7a12c9c9 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.094140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cddfcba5ecec46fc8638d3fd2192fd69', 'request_id': 'req-1e9c153b-af54-457f-8552-9858e61d7ba2'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:05.155332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cddfcba5ecec46fc8638d3fd2192fd69', 'request_id': 'req-1e9c153b-af54-457f-8552-9858e61d7ba2'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:05.159635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.160514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.160877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.166253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.166253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:05.166253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.166253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.166728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cddfcba5ecec46fc8638d3fd2192fd69', 'request_id': 'req-1e9c153b-af54-457f-8552-9858e61d7ba2'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:05.185337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1072/2133] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:05.189154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.201245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] The token cache is being invalidate because project cddfcba5ecec46fc8638d3fd2192fd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:05.201446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c66e4-d20e-4a16-b056-421a4538e3e1 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.201535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:05.203106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1e9c153b-af54-457f-8552-9858e61d7ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:05.206720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.207661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.207952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.208141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1062/2134] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:04 2022] DELETE /identity/v3/projects/cddfcba5ecec46fc8638d3fd2192fd69 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:05.208589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.209438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.211738 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.213083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fba512-78be-4a92-a5d9-5725f9b13c36 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.217300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fba512-78be-4a92-a5d9-5725f9b13c36 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.217300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fba512-78be-4a92-a5d9-5725f9b13c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.236771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:05.275259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-44fba512-78be-4a92-a5d9-5725f9b13c36 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:05.276508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-44fba512-78be-4a92-a5d9-5725f9b13c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:05.296021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1063/2135] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:05.305130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c448-7005-4255-bf37-ddfabfa6be31 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.305443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c448-7005-4255-bf37-ddfabfa6be31 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.305741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c448-7005-4255-bf37-ddfabfa6be31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.331822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-6924c448-7005-4255-bf37-ddfabfa6be31 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:05.333447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6924c448-7005-4255-bf37-ddfabfa6be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:05.347797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1073/2136] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:05 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:05.353214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.354769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1064/2137] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:05.356620 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:05.357950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924c448-7005-4255-bf37-ddfabfa6be31 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.371921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924c448-7005-4255-bf37-ddfabfa6be31 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.554255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.555354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.555823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.556252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.557593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:05.562506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.564334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.565071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f55a3b-f547-47b5-91d6-eca57a5fb263 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.580076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1065/2138] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:05.587281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.595519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810af6-173a-4bc5-8cd2-621a722f0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.597293 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810af6-173a-4bc5-8cd2-621a722f0f8a admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.597758 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810af6-173a-4bc5-8cd2-621a722f0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.598498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810af6-173a-4bc5-8cd2-621a722f0f8a admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.600108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c810af6-173a-4bc5-8cd2-621a722f0f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.607284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c810af6-173a-4bc5-8cd2-621a722f0f8a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.610300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70aba0-7425-47a6-92dc-5bc041501c3a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.621495 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e3b6-3353-47b2-9004-7c4fb84e4b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.623507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e3b6-3353-47b2-9004-7c4fb84e4b83 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.624458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e3b6-3353-47b2-9004-7c4fb84e4b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.625222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e3b6-3353-47b2-9004-7c4fb84e4b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.626911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820e3b6-3353-47b2-9004-7c4fb84e4b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.631795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820e3b6-3353-47b2-9004-7c4fb84e4b83 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.691997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1074/2139] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:05 2022] POST /identity/v3/users => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:05.695242 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810af6-173a-4bc5-8cd2-621a722f0f8a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.720950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810af6-173a-4bc5-8cd2-621a722f0f8a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.736051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8316-16b9-4d2c-92e2-41ee122d4dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.736763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8316-16b9-4d2c-92e2-41ee122d4dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.737048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8316-16b9-4d2c-92e2-41ee122d4dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.738051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8316-16b9-4d2c-92e2-41ee122d4dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.739367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca8316-16b9-4d2c-92e2-41ee122d4dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.741007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca8316-16b9-4d2c-92e2-41ee122d4dd1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.760201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1066/2140] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:05 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:05.765681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e3b6-3353-47b2-9004-7c4fb84e4b83 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.770232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1075/2141] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:05.775124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8316-16b9-4d2c-92e2-41ee122d4dd1 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.797456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8316-16b9-4d2c-92e2-41ee122d4dd1 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.902192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e3b6-3353-47b2-9004-7c4fb84e4b83 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.904606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1ad0b-1e3d-4b9c-8e57-bb3e31c5a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.905288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1ad0b-1e3d-4b9c-8e57-bb3e31c5a75f admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.905574 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1ad0b-1e3d-4b9c-8e57-bb3e31c5a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.905892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1ad0b-1e3d-4b9c-8e57-bb3e31c5a75f admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.906658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1ad0b-1e3d-4b9c-8e57-bb3e31c5a75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.908277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1ad0b-1e3d-4b9c-8e57-bb3e31c5a75f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.908920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72292839-9e8d-4231-bdf8-6437bb104f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.910405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292839-9e8d-4231-bdf8-6437bb104f6e admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.910798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292839-9e8d-4231-bdf8-6437bb104f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.911226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292839-9e8d-4231-bdf8-6437bb104f6e admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.912037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72292839-9e8d-4231-bdf8-6437bb104f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.915146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72292839-9e8d-4231-bdf8-6437bb104f6e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.920627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1076/2142] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:05.927820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1ad0b-1e3d-4b9c-8e57-bb3e31c5a75f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.936431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1ad0b-1e3d-4b9c-8e57-bb3e31c5a75f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.947210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd567446-066b-4229-b646-4eb89681b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.948326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567446-066b-4229-b646-4eb89681b80f admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.948739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567446-066b-4229-b646-4eb89681b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.949089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567446-066b-4229-b646-4eb89681b80f admin admin] PATH_INFO: `/v3/projects/475700144b0f4f70ac8b803db620eccb/users/6e5b57e7f1b9495ba481a66c646939f5/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.953539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:05.970930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd567446-066b-4229-b646-4eb89681b80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=475700144b0f4f70ac8b803db620eccb, user_id=6e5b57e7f1b9495ba481a66c646939f5, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.975875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd567446-066b-4229-b646-4eb89681b80f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:06.062120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1067/2143] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:05 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:06.066759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72292839-9e8d-4231-bdf8-6437bb104f6e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:06.080296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72292839-9e8d-4231-bdf8-6437bb104f6e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:06.087547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88a48-4f74-4568-999d-2f16f84f869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:06.092072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88a48-4f74-4568-999d-2f16f84f869a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:06.092072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88a48-4f74-4568-999d-2f16f84f869a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:06.092072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88a48-4f74-4568-999d-2f16f84f869a admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:06.092072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e88a48-4f74-4568-999d-2f16f84f869a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:06.092997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e88a48-4f74-4568-999d-2f16f84f869a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:06.106786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1068/2144] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:06.120139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1077/2145] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:05 2022] PUT /identity/v3/projects/475700144b0f4f70ac8b803db620eccb/users/6e5b57e7f1b9495ba481a66c646939f5/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:06.120954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88a48-4f74-4568-999d-2f16f84f869a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:06.132458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07201370-bdf7-40ea-8551-c8a46e095b3a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:06.132890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07201370-bdf7-40ea-8551-c8a46e095b3a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:06.133206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07201370-bdf7-40ea-8551-c8a46e095b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:06.177467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88a48-4f74-4568-999d-2f16f84f869a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:06.241455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-07201370-bdf7-40ea-8551-c8a46e095b3a None None] MFA Rules not processed for user `6e5b57e7f1b9495ba481a66c646939f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:06.250280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-07201370-bdf7-40ea-8551-c8a46e095b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:06.366112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691674e-1903-4740-b54c-c1b01a852313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:06.373068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691674e-1903-4740-b54c-c1b01a852313 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:06.373068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691674e-1903-4740-b54c-c1b01a852313 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:06.373068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691674e-1903-4740-b54c-c1b01a852313 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:06.373068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691674e-1903-4740-b54c-c1b01a852313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:06.373068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691674e-1903-4740-b54c-c1b01a852313 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:06.400042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1069/2146] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:06.405801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691674e-1903-4740-b54c-c1b01a852313 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:06.419692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1078/2147] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:06.423657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691674e-1903-4740-b54c-c1b01a852313 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:06.431423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07201370-bdf7-40ea-8551-c8a46e095b3a None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:06.439731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-07201370-bdf7-40ea-8551-c8a46e095b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:06.439980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26703-07c5-4e41-a09b-10e199937c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:06.441771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26703-07c5-4e41-a09b-10e199937c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:06.443059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26703-07c5-4e41-a09b-10e199937c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:06.443601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26703-07c5-4e41-a09b-10e199937c80 admin admin] PATH_INFO: `/v3/projects/fba7ff016a4f4d2da8bc19ff3c695f13/users/6a642cf449c348ff9efe19bd225ea038/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:06.480757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c26703-07c5-4e41-a09b-10e199937c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba7ff016a4f4d2da8bc19ff3c695f13, user_id=6a642cf449c348ff9efe19bd225ea038, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:06.483585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c26703-07c5-4e41-a09b-10e199937c80 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:06.550536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07201370-bdf7-40ea-8551-c8a46e095b3a None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:06.555935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4c61c-3999-4d2a-88de-9dcb7853a6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:06.559691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c61c-3999-4d2a-88de-9dcb7853a6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:06.559691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c61c-3999-4d2a-88de-9dcb7853a6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:06.559691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c61c-3999-4d2a-88de-9dcb7853a6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:06.576043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4c61c-3999-4d2a-88de-9dcb7853a6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:06.577958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4c61c-3999-4d2a-88de-9dcb7853a6b4 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:06.590876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1079/2149] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:06.593677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1070/2149] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:06 2022] PUT /identity/v3/projects/fba7ff016a4f4d2da8bc19ff3c695f13/users/6a642cf449c348ff9efe19bd225ea038/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:06.595885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cf48-0234-41af-b3bd-53d18b791e73 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:06.596434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cf48-0234-41af-b3bd-53d18b791e73 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:06.597428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cf48-0234-41af-b3bd-53d18b791e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:06.603529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:06.650545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-2d89cf48-0234-41af-b3bd-53d18b791e73 None None] MFA Rules not processed for user `6a642cf449c348ff9efe19bd225ea038`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:06.651896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2d89cf48-0234-41af-b3bd-53d18b791e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:06.810470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1080/2150] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:06.813698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26703-07c5-4e41-a09b-10e199937c80 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:06.919492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26703-07c5-4e41-a09b-10e199937c80 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:06.925636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bfb8-c8c8-4af7-90c8-184b98445a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:06.927168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bfb8-c8c8-4af7-90c8-184b98445a93 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:06.927168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bfb8-c8c8-4af7-90c8-184b98445a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:06.927168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bfb8-c8c8-4af7-90c8-184b98445a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:06.927767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07bfb8-c8c8-4af7-90c8-184b98445a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:06.929782 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07bfb8-c8c8-4af7-90c8-184b98445a93 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:07.026165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1071/2151] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:06 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:07.039940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89cf48-0234-41af-b3bd-53d18b791e73 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:07.059269 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89cf48-0234-41af-b3bd-53d18b791e73 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:07.069110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:07.160943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c615f6-aaf6-4924-831d-0d90c16d47f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:07.161899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c615f6-aaf6-4924-831d-0d90c16d47f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.162586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c615f6-aaf6-4924-831d-0d90c16d47f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.163499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c615f6-aaf6-4924-831d-0d90c16d47f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:07.176256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c615f6-aaf6-4924-831d-0d90c16d47f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:07.179800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c615f6-aaf6-4924-831d-0d90c16d47f8 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:07.384399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1081/2152] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:07 2022] POST /identity/v3/users => generated 290 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:07.389366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bfb8-c8c8-4af7-90c8-184b98445a93 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:07.402043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bfb8-c8c8-4af7-90c8-184b98445a93 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:07.411571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a13d2-2911-4df1-8f51-5e02027dfcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:07.411571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a13d2-2911-4df1-8f51-5e02027dfcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.411571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a13d2-2911-4df1-8f51-5e02027dfcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.411571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a13d2-2911-4df1-8f51-5e02027dfcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:07.412010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a13d2-2911-4df1-8f51-5e02027dfcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:07.412913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a13d2-2911-4df1-8f51-5e02027dfcb6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:07.429224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1072/2153] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:07.432607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c615f6-aaf6-4924-831d-0d90c16d47f8 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:07.449240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c615f6-aaf6-4924-831d-0d90c16d47f8 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:07.455562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c56b7-e86e-4972-a90d-05e1d7a5f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:07.458223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c56b7-e86e-4972-a90d-05e1d7a5f190 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.458693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c56b7-e86e-4972-a90d-05e1d7a5f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.459193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c56b7-e86e-4972-a90d-05e1d7a5f190 admin admin] PATH_INFO: `/v3/projects/9bf7b54d49554aa698c3259496714f62/users/2818e4312138441897ae407c1cffdc9a/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:07.483961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c56b7-e86e-4972-a90d-05e1d7a5f190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf7b54d49554aa698c3259496714f62, user_id=2818e4312138441897ae407c1cffdc9a, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:07.490168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c56b7-e86e-4972-a90d-05e1d7a5f190 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:07.557633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1082/2154] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:07 2022] PUT /identity/v3/projects/9bf7b54d49554aa698c3259496714f62/users/2818e4312138441897ae407c1cffdc9a/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:07.562685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a13d2-2911-4df1-8f51-5e02027dfcb6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:07.586672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a13d2-2911-4df1-8f51-5e02027dfcb6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:07.701145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6a5ca-ad95-46dd-9a56-8268f807a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:07.701859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a5ca-ad95-46dd-9a56-8268f807a21f admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.702235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a5ca-ad95-46dd-9a56-8268f807a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.702544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a5ca-ad95-46dd-9a56-8268f807a21f admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:07.703354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6a5ca-ad95-46dd-9a56-8268f807a21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:07.705049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6a5ca-ad95-46dd-9a56-8268f807a21f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:07.724838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1073/2155] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:07.725727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c56b7-e86e-4972-a90d-05e1d7a5f190 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:07.751262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c56b7-e86e-4972-a90d-05e1d7a5f190 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:07.760028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:07.760941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.761285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.761566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] PATH_INFO: `/v3/projects/9bf7b54d49554aa698c3259496714f62/users/2818e4312138441897ae407c1cffdc9a/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:07.764532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf7b54d49554aa698c3259496714f62, user_id=2818e4312138441897ae407c1cffdc9a, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:07.768296 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:07.791653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1083/2156] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:07 2022] PUT /identity/v3/projects/9bf7b54d49554aa698c3259496714f62/users/2818e4312138441897ae407c1cffdc9a/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:07.797082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e810b4-2e55-4df4-ab37-0b4a16732e76 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.798050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e810b4-2e55-4df4-ab37-0b4a16732e76 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.799059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:07.799744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e810b4-2e55-4df4-ab37-0b4a16732e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:07.830164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b1e810b4-2e55-4df4-ab37-0b4a16732e76 None None] MFA Rules not processed for user `2818e4312138441897ae407c1cffdc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:07.835878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b1e810b4-2e55-4df4-ab37-0b4a16732e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:07.921345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1074/2157] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:07.951864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:07.954451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:07.967599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e810b4-2e55-4df4-ab37-0b4a16732e76 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:08.074056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9ca4c-2fa2-4afa-bda0-4bff3f3a8f8e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:08.078355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e810b4-2e55-4df4-ab37-0b4a16732e76 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:08.079502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:08.080155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:08.080604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:08.081450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] PATH_INFO: `/v3/users/a89c3d142f014b13a6d1d1f2579b996e` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:08.082889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89c3d142f014b13a6d1d1f2579b996e)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:08.085043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:08.087163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5ce6d-7165-4403-bf47-bff4a9ec70dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:08.088091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5ce6d-7165-4403-bf47-bff4a9ec70dd service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:08.088434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5ce6d-7165-4403-bf47-bff4a9ec70dd service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:08.088718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5ce6d-7165-4403-bf47-bff4a9ec70dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:08.100068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5ce6d-7165-4403-bf47-bff4a9ec70dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:08.101914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5ce6d-7165-4403-bf47-bff4a9ec70dd service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:08.113059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1075/2158] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:08.276377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89c3d142f014b13a6d1d1f2579b996e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:08.344622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89c3d142f014b13a6d1d1f2579b996e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:08.354219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:08.365192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89c3d142f014b13a6d1d1f2579b996e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:08.376331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89c3d142f014b13a6d1d1f2579b996e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:08.380521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89c3d142f014b13a6d1d1f2579b996e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:08.385180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1084/2159] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:07 2022] DELETE /identity/v3/users/a89c3d142f014b13a6d1d1f2579b996e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:08.390400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ce1c0-919e-40d1-8668-6b46506727de None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:08.391224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ce1c0-919e-40d1-8668-6b46506727de None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:08.391712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ce1c0-919e-40d1-8668-6b46506727de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:08.412034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9b2ce1c0-919e-40d1-8668-6b46506727de None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:08.413332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9b2ce1c0-919e-40d1-8668-6b46506727de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:08.460250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:08.510691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1076/2160] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:08.533322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:08.535096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:08.630373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1b39-8cf0-4b3f-9768-603f5c196c8d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:08.637164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbfa29-86fa-4646-90ea-691b1dbb3f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:08.637866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbfa29-86fa-4646-90ea-691b1dbb3f06 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:08.638190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbfa29-86fa-4646-90ea-691b1dbb3f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:08.638475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbfa29-86fa-4646-90ea-691b1dbb3f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:08.650456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbfa29-86fa-4646-90ea-691b1dbb3f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:08.653013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbfa29-86fa-4646-90ea-691b1dbb3f06 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:08.666542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1085/2161] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:09.813176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ce1c0-919e-40d1-8668-6b46506727de None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:09.816413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9b2ce1c0-919e-40d1-8668-6b46506727de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:09.833561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ce1c0-919e-40d1-8668-6b46506727de None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:09.842163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:09.843588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:09.843877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:09.844160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] PATH_INFO: `/v3/projects/49392ed2b9424172b301e3627fdd346a` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:09.846260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49392ed2b9424172b301e3627fdd346a)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:09.849050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:10.013466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49392ed2b9424172b301e3627fdd346a', 'request_id': 'req-78f88a42-254f-47c5-accd-b5cb409f037a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:10.090256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49392ed2b9424172b301e3627fdd346a', 'request_id': 'req-78f88a42-254f-47c5-accd-b5cb409f037a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:10.097898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49392ed2b9424172b301e3627fdd346a', 'request_id': 'req-78f88a42-254f-47c5-accd-b5cb409f037a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:10.126670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] The token cache is being invalidate because project 49392ed2b9424172b301e3627fdd346a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:10.127014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:10.128326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-78f88a42-254f-47c5-accd-b5cb409f037a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:10.133126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1077/2162] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:09 2022] DELETE /identity/v3/projects/49392ed2b9424172b301e3627fdd346a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:10.134886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc924bb-99f8-4467-9d4f-b834f68919ce None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.135352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc924bb-99f8-4467-9d4f-b834f68919ce None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.135474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc924bb-99f8-4467-9d4f-b834f68919ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.174077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9bc924bb-99f8-4467-9d4f-b834f68919ce None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:10.175993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9bc924bb-99f8-4467-9d4f-b834f68919ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:10.306640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1086/2163] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:10.316524 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967be0-3c25-4b9c-b609-9d9318575dc1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.320006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967be0-3c25-4b9c-b609-9d9318575dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.320522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967be0-3c25-4b9c-b609-9d9318575dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.348966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-10967be0-3c25-4b9c-b609-9d9318575dc1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:10.351216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-10967be0-3c25-4b9c-b609-9d9318575dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:10.365781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1078/2164] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:10.367313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc924bb-99f8-4467-9d4f-b834f68919ce None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:10.380713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc924bb-99f8-4467-9d4f-b834f68919ce None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:10.387379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:10.388136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.388493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.388705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.389405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:10.389711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:10.391348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:10.413439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1087/2165] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:56:10.416572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10967be0-3c25-4b9c-b609-9d9318575dc1 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:10.432221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10967be0-3c25-4b9c-b609-9d9318575dc1 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:10.437147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:10.437921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.438387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.439127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.439505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:10.441583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:10.534250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1079/2166] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:10 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:10.539162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:10.550894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836e26a-52cc-4aa8-a0f8-8292e6e1299f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:10.630883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:10.632879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:10.645389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea06090-3ae9-43db-b18e-76350872011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:10.645389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06090-3ae9-43db-b18e-76350872011e admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.645731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06090-3ae9-43db-b18e-76350872011e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.645913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06090-3ae9-43db-b18e-76350872011e admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.647995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea06090-3ae9-43db-b18e-76350872011e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:10.650054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea06090-3ae9-43db-b18e-76350872011e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:10.712284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2264dfa-df06-475b-b309-7a5031963300 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:10.717388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:10.723141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.723141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.723141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.723141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:10.779531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:10.790291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1088/2167] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:10 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:10.795227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea06090-3ae9-43db-b18e-76350872011e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:10.826177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea06090-3ae9-43db-b18e-76350872011e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:10.839643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64435028-ce39-46b0-8f00-ca798012b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:10.841205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435028-ce39-46b0-8f00-ca798012b672 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.842910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435028-ce39-46b0-8f00-ca798012b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.842910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435028-ce39-46b0-8f00-ca798012b672 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.846717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435028-ce39-46b0-8f00-ca798012b672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:10.850550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435028-ce39-46b0-8f00-ca798012b672 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:10.870723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:10.881475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1089/2168] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:10.885538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64435028-ce39-46b0-8f00-ca798012b672 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:10.899333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:10.901560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:10.908104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64435028-ce39-46b0-8f00-ca798012b672 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:10.917223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644370d-0f1e-45e2-9ddc-898f463bd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:10.923522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644370d-0f1e-45e2-9ddc-898f463bd3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.923522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644370d-0f1e-45e2-9ddc-898f463bd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.923522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644370d-0f1e-45e2-9ddc-898f463bd3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.923522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644370d-0f1e-45e2-9ddc-898f463bd3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:10.923522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644370d-0f1e-45e2-9ddc-898f463bd3d8 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:10.924565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1080/2169] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:10.942285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1090/2170] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:10.949787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:10.963834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dbd98-eb8f-433c-8c29-19e286795684 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:10.969828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:10.970933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:10.971424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:10.972236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] PATH_INFO: `/v3/projects/b2d5c0caaa6046c9b03a97debda02005/users/0cfac79eaf084d539dcc0ca84b90cfcc/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:10.991502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d5c0caaa6046c9b03a97debda02005, user_id=0cfac79eaf084d539dcc0ca84b90cfcc, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:10.995200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:11.059514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1081/2171] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:10 2022] PUT /identity/v3/projects/b2d5c0caaa6046c9b03a97debda02005/users/0cfac79eaf084d539dcc0ca84b90cfcc/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:11.071487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e719f-9a09-47e1-9b54-685328f2753d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:11.072331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e719f-9a09-47e1-9b54-685328f2753d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:11.072915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e719f-9a09-47e1-9b54-685328f2753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:11.105212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-da3e719f-9a09-47e1-9b54-685328f2753d None None] MFA Rules not processed for user `0cfac79eaf084d539dcc0ca84b90cfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:11.106934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-da3e719f-9a09-47e1-9b54-685328f2753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:11.198958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1091/2172] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:11.228040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:11.229647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:11.312128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6922-e7ba-471e-8103-82bdbb34df51 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:11.323862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3386e-81d1-4873-beff-5b4dd659edd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:11.326992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3386e-81d1-4873-beff-5b4dd659edd2 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:11.326992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3386e-81d1-4873-beff-5b4dd659edd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:11.326992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3386e-81d1-4873-beff-5b4dd659edd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:11.336230 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3386e-81d1-4873-beff-5b4dd659edd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:11.337877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3386e-81d1-4873-beff-5b4dd659edd2 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:11.348220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1082/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:11.951126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e719f-9a09-47e1-9b54-685328f2753d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:12.067997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e719f-9a09-47e1-9b54-685328f2753d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:12.074304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:12.076212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:12.076564 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:12.076856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] PATH_INFO: `/v3/users/0cfac79eaf084d539dcc0ca84b90cfcc` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:12.078381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cfac79eaf084d539dcc0ca84b90cfcc)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:12.083509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:12.266309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cfac79eaf084d539dcc0ca84b90cfcc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:12.333903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cfac79eaf084d539dcc0ca84b90cfcc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:12.346958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:12.349538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cfac79eaf084d539dcc0ca84b90cfcc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:12.357096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cfac79eaf084d539dcc0ca84b90cfcc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:12.357884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cfac79eaf084d539dcc0ca84b90cfcc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:12.371850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1092/2174] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:11 2022] DELETE /identity/v3/users/0cfac79eaf084d539dcc0ca84b90cfcc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:12.374584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235243-06e0-4d24-9541-6226ab122a66 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:12.375088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235243-06e0-4d24-9541-6226ab122a66 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:12.375587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235243-06e0-4d24-9541-6226ab122a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:12.399047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ac235243-06e0-4d24-9541-6226ab122a66 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:12.400330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ac235243-06e0-4d24-9541-6226ab122a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:12.469195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1083/2175] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:12.508249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:12.510366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:12.591531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916385ca-8dd4-436e-a374-eb09c802c9f5 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:12.595997 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ba3c5-9a15-4bf7-95ae-394a07c6a2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:12.597299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba3c5-9a15-4bf7-95ae-394a07c6a2ad service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:12.597588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba3c5-9a15-4bf7-95ae-394a07c6a2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:12.598920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba3c5-9a15-4bf7-95ae-394a07c6a2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:12.601855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235243-06e0-4d24-9541-6226ab122a66 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:12.604261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ac235243-06e0-4d24-9541-6226ab122a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:12.615864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ba3c5-9a15-4bf7-95ae-394a07c6a2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:12.618189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ba3c5-9a15-4bf7-95ae-394a07c6a2ad service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:12.628958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235243-06e0-4d24-9541-6226ab122a66 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:12.639263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1093/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:12.648850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:12.649749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:12.654191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:12.654191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] PATH_INFO: `/v3/users/6a642cf449c348ff9efe19bd225ea038` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:12.654191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a642cf449c348ff9efe19bd225ea038)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:12.654191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:12.925708 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a642cf449c348ff9efe19bd225ea038'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:13.059514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a642cf449c348ff9efe19bd225ea038'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:13.071975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:13.078235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a642cf449c348ff9efe19bd225ea038'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:13.079867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a642cf449c348ff9efe19bd225ea038'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:13.103817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a642cf449c348ff9efe19bd225ea038'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:13.124545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1084/2177] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:12 2022] DELETE /identity/v3/users/6a642cf449c348ff9efe19bd225ea038 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:13.126958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e89a6-7923-47bc-87e9-a6206954ad33 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:13.127460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e89a6-7923-47bc-87e9-a6206954ad33 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:13.129136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e89a6-7923-47bc-87e9-a6206954ad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:13.174554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-379e89a6-7923-47bc-87e9-a6206954ad33 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:13.177090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-379e89a6-7923-47bc-87e9-a6206954ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:13.295725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1094/2178] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:13.344061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:13.349689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:13.463953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e082af-74b5-44ae-8861-868ac1167b90 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:13.468616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:13.470238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:13.470715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:13.474488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:13.486141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:13.487951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:13.500396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1085/2179] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:13.883554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e89a6-7923-47bc-87e9-a6206954ad33 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:13.885058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-379e89a6-7923-47bc-87e9-a6206954ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:13.903748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e89a6-7923-47bc-87e9-a6206954ad33 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:13.910193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:13.911478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:13.911927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:13.912400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] PATH_INFO: `/v3/users/59a82ad0659d4a179b9c1291a1c8a37f` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:13.914091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a82ad0659d4a179b9c1291a1c8a37f)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:13.916600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:14.092183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a82ad0659d4a179b9c1291a1c8a37f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.194026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:14.195539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:14.214836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240261e-e204-4c74-9d89-ae82a65505b3 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:14.229696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a82ad0659d4a179b9c1291a1c8a37f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.235792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:14.237864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:14.238264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:14.238631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] PATH_INFO: `/v3/projects/b2d5c0caaa6046c9b03a97debda02005` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:14.240210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d5c0caaa6046c9b03a97debda02005)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:14.242465 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:14.266364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a82ad0659d4a179b9c1291a1c8a37f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.278398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a82ad0659d4a179b9c1291a1c8a37f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.279464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b572c481-1e8c-4717-b34e-1aa7b2c8761a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a82ad0659d4a179b9c1291a1c8a37f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.284797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:14.289742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1095/2180] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:13 2022] DELETE /identity/v3/users/59a82ad0659d4a179b9c1291a1c8a37f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:14.295275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea0f7-e906-4b18-9057-e12e57e78fb3 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:14.295956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea0f7-e906-4b18-9057-e12e57e78fb3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:14.296571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea0f7-e906-4b18-9057-e12e57e78fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:14.317597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-8c1ea0f7-e906-4b18-9057-e12e57e78fb3 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:14.319557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8c1ea0f7-e906-4b18-9057-e12e57e78fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:14.438894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1096/2181] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:14.444364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d5c0caaa6046c9b03a97debda02005', 'request_id': 'req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.470755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ea0f7-e906-4b18-9057-e12e57e78fb3 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:14.474604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8c1ea0f7-e906-4b18-9057-e12e57e78fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:14.537997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d5c0caaa6046c9b03a97debda02005', 'request_id': 'req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.545359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d5c0caaa6046c9b03a97debda02005', 'request_id': 'req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.571756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] The token cache is being invalidate because project b2d5c0caaa6046c9b03a97debda02005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:14.572051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.572961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:14.590405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1086/2182] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:14 2022] DELETE /identity/v3/projects/b2d5c0caaa6046c9b03a97debda02005 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:14.604998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ea0f7-e906-4b18-9057-e12e57e78fb3 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:14.692069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:14.692762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:14.693054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:14.693359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:14.695738 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:14.736877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:14.739607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:14.841876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:14.843806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:14.851590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6fbb-ddbe-4b39-88e7-9fa4c228bdde admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:14.857625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:14.858352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1097/2183] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:14.858945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:14.859387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:14.859666 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] PATH_INFO: `/v3/projects/fba7ff016a4f4d2da8bc19ff3c695f13` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:14.860901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba7ff016a4f4d2da8bc19ff3c695f13)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:14.863487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:14.875420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:15.051716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba7ff016a4f4d2da8bc19ff3c695f13', 'request_id': 'req-5274a65c-973b-415e-80a1-a781d6d48981'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.167231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba7ff016a4f4d2da8bc19ff3c695f13', 'request_id': 'req-5274a65c-973b-415e-80a1-a781d6d48981'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.177184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba7ff016a4f4d2da8bc19ff3c695f13', 'request_id': 'req-5274a65c-973b-415e-80a1-a781d6d48981'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.191290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] The token cache is being invalidate because project fba7ff016a4f4d2da8bc19ff3c695f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:15.191727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.192594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.199477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1087/2184] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:14 2022] DELETE /identity/v3/projects/fba7ff016a4f4d2da8bc19ff3c695f13 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:15.200561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:15.213658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4186685-3073-42d5-ba53-a81a3b770427 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:15.228984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:15.320494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:15.321425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:15.321649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:15.321942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] PATH_INFO: `/v3/users/2818e4312138441897ae407c1cffdc9a` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:15.324458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2818e4312138441897ae407c1cffdc9a)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:15.325471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:15.623424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2818e4312138441897ae407c1cffdc9a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.727161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2818e4312138441897ae407c1cffdc9a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.742440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2818e4312138441897ae407c1cffdc9a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.751892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2818e4312138441897ae407c1cffdc9a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.753687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2818e4312138441897ae407c1cffdc9a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:15.763977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1098/2185] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:15 2022] DELETE /identity/v3/users/2818e4312138441897ae407c1cffdc9a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:15.790998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:15.793290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:15.811036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274a65c-973b-415e-80a1-a781d6d48981 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:15.911925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:15.913768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:15.913768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:15.913768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] PATH_INFO: `/v3/projects/1a9d115a02004f7dbb3ce63bd2e38a5d` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:15.916219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9d115a02004f7dbb3ce63bd2e38a5d)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:15.922785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:16.103991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9d115a02004f7dbb3ce63bd2e38a5d', 'request_id': 'req-d773a1f3-329a-4d38-bad8-556a35d04b0e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.178843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9d115a02004f7dbb3ce63bd2e38a5d', 'request_id': 'req-d773a1f3-329a-4d38-bad8-556a35d04b0e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.187527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9d115a02004f7dbb3ce63bd2e38a5d', 'request_id': 'req-d773a1f3-329a-4d38-bad8-556a35d04b0e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.212383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] The token cache is being invalidate because project 1a9d115a02004f7dbb3ce63bd2e38a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:16.212795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.213535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.218147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1088/2186] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:15 2022] DELETE /identity/v3/projects/1a9d115a02004f7dbb3ce63bd2e38a5d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:16.219736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:16.223358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:16.264160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ab8c1-c83e-45f6-a815-4bc0b7b87420 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:16.453571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:16.455497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:16.456012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:16.456439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] PATH_INFO: `/v3/users/01e3e30fc2044db9b2d54788a17da84e` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:16.465243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e3e30fc2044db9b2d54788a17da84e)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:16.480507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:16.619109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:16.715810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e3e30fc2044db9b2d54788a17da84e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.797140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e3e30fc2044db9b2d54788a17da84e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.832184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e3e30fc2044db9b2d54788a17da84e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.844873 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e3e30fc2044db9b2d54788a17da84e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.846125 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-361959d6-a264-409e-b1ba-05816bb8d313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e3e30fc2044db9b2d54788a17da84e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:16.863302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1099/2187] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:16 2022] DELETE /identity/v3/users/01e3e30fc2044db9b2d54788a17da84e => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:17.380743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:17.382361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:17.399029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773a1f3-329a-4d38-bad8-556a35d04b0e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:17.466215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:17.521646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:17.523084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:17.523811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:17.524332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] PATH_INFO: `/v3/projects/9bf7b54d49554aa698c3259496714f62` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:17.528220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf7b54d49554aa698c3259496714f62)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:17.530531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:17.698532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf7b54d49554aa698c3259496714f62', 'request_id': 'req-6ef38036-20ef-4e2d-a753-6199be061e60'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:17.767140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf7b54d49554aa698c3259496714f62', 'request_id': 'req-6ef38036-20ef-4e2d-a753-6199be061e60'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:17.779107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf7b54d49554aa698c3259496714f62', 'request_id': 'req-6ef38036-20ef-4e2d-a753-6199be061e60'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:17.812940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] The token cache is being invalidate because project 9bf7b54d49554aa698c3259496714f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:17.813519 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:17.818478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6ef38036-20ef-4e2d-a753-6199be061e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:17.822385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1089/2188] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:17 2022] DELETE /identity/v3/projects/9bf7b54d49554aa698c3259496714f62 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:17.823012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c70c5-00be-4f28-88a6-60dc151f7e6d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:17.823960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c70c5-00be-4f28-88a6-60dc151f7e6d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:17.824265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c70c5-00be-4f28-88a6-60dc151f7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:17.857110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-919c70c5-00be-4f28-88a6-60dc151f7e6d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:17.858829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-919c70c5-00be-4f28-88a6-60dc151f7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:17.957621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5217-394b-422e-a68f-a85d2c85d094 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:17.957621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5217-394b-422e-a68f-a85d2c85d094 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:17.957621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5217-394b-422e-a68f-a85d2c85d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:17.963413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1100/2189] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:17.986845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a83c5217-394b-422e-a68f-a85d2c85d094 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:17.989229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a83c5217-394b-422e-a68f-a85d2c85d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:18.001895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1090/2190] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:18.007850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c70c5-00be-4f28-88a6-60dc151f7e6d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.031422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c70c5-00be-4f28-88a6-60dc151f7e6d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.043446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.044750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.045301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.046727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.048418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:18.048993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.051684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.069027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1101/2191] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:18.074526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c5217-394b-422e-a68f-a85d2c85d094 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.091829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c5217-394b-422e-a68f-a85d2c85d094 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.106855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff8f73-eb68-4746-90dc-820c5d11b848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.107865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8f73-eb68-4746-90dc-820c5d11b848 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.108155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8f73-eb68-4746-90dc-820c5d11b848 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.109690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8f73-eb68-4746-90dc-820c5d11b848 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.110578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff8f73-eb68-4746-90dc-820c5d11b848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.113456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff8f73-eb68-4746-90dc-820c5d11b848 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.145841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.150052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:18.188098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb4045-e5ec-4f09-9f71-a68a5823e1e9 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.204468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.205511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.206515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.211695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] PATH_INFO: `/v3/projects/baab73727cf2484d8303b02f6901a72a` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.213549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=baab73727cf2484d8303b02f6901a72a)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.216860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.280885 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1091/2192] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:18 2022] POST /identity/v3/projects => generated 407 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:18.282672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff8f73-eb68-4746-90dc-820c5d11b848 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.387199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baab73727cf2484d8303b02f6901a72a', 'request_id': 'req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:18.448322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff8f73-eb68-4746-90dc-820c5d11b848 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.463897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baab73727cf2484d8303b02f6901a72a', 'request_id': 'req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:18.476678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baab73727cf2484d8303b02f6901a72a', 'request_id': 'req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:18.505638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] The token cache is being invalidate because project baab73727cf2484d8303b02f6901a72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:18.505974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:18.510994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5316c0e8-4ac8-45aa-b4a5-fd3e118001fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:18.519595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1102/2193] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:18 2022] DELETE /identity/v3/projects/baab73727cf2484d8303b02f6901a72a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:18.521280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a042-9ce1-4d63-95ba-43b37b05a6c5 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.522556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a042-9ce1-4d63-95ba-43b37b05a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.523102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a042-9ce1-4d63-95ba-43b37b05a6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.536143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.537489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.538081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.538631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.539894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.542687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.567587 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6887a042-9ce1-4d63-95ba-43b37b05a6c5 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:18.569029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6887a042-9ce1-4d63-95ba-43b37b05a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:18.590512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1103/2194] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:18.599053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e657a-b0cb-4d47-9bef-3cb283f29264 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.600468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e657a-b0cb-4d47-9bef-3cb283f29264 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.600607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e657a-b0cb-4d47-9bef-3cb283f29264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.634013 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1092/2195] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:18 2022] POST /identity/v3/users => generated 304 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:56:18.635500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.640860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:18.642088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-7e7e657a-b0cb-4d47-9bef-3cb283f29264 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:18.643539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7e7e657a-b0cb-4d47-9bef-3cb283f29264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:18.674311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1104/2196] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:18.683212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e657a-b0cb-4d47-9bef-3cb283f29264 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.685964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c7a2-fd74-4a89-924c-22ea112a4f7b admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.687928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:18.695103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e657a-b0cb-4d47-9bef-3cb283f29264 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.703209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead81df-e9a1-42cc-91f9-e12170cd96b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.703986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead81df-e9a1-42cc-91f9-e12170cd96b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.706062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead81df-e9a1-42cc-91f9-e12170cd96b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.706062 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead81df-e9a1-42cc-91f9-e12170cd96b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.706742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead81df-e9a1-42cc-91f9-e12170cd96b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.706851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.707459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.707743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.708018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.708972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:18.709286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.710928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.712219 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead81df-e9a1-42cc-91f9-e12170cd96b0 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.750882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1105/2197] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:56:18.751576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.761523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1093/2198] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:18.762707 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead81df-e9a1-42cc-91f9-e12170cd96b0 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.764941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45148aa5-aeec-4710-8d73-4835ef155b04 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.776488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead81df-e9a1-42cc-91f9-e12170cd96b0 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.777982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278326a-d2dc-4d6f-b463-4c086aa18277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.779322 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278326a-d2dc-4d6f-b463-4c086aa18277 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.779610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278326a-d2dc-4d6f-b463-4c086aa18277 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.780043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278326a-d2dc-4d6f-b463-4c086aa18277 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.780753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278326a-d2dc-4d6f-b463-4c086aa18277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.782746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278326a-d2dc-4d6f-b463-4c086aa18277 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.783745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66e47d-ada0-4bba-ae61-194e8203329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.785261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66e47d-ada0-4bba-ae61-194e8203329c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.785385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66e47d-ada0-4bba-ae61-194e8203329c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.785588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66e47d-ada0-4bba-ae61-194e8203329c admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.787506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66e47d-ada0-4bba-ae61-194e8203329c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.789023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66e47d-ada0-4bba-ae61-194e8203329c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.809884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:18.811094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1094/2199] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:18.813128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66e47d-ada0-4bba-ae61-194e8203329c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.829661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66e47d-ada0-4bba-ae61-194e8203329c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:18.838872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8100c8-f577-4b7f-92c0-7a4944b5e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:18.839873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8100c8-f577-4b7f-92c0-7a4944b5e7be admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.840162 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8100c8-f577-4b7f-92c0-7a4944b5e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.840558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8100c8-f577-4b7f-92c0-7a4944b5e7be admin admin] PATH_INFO: `/v3/projects/55a8560d8dc34e11801d8dda9b51286c/users/79bcc38a935748e49e1501ae31e49e51/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:18.861403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8100c8-f577-4b7f-92c0-7a4944b5e7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a8560d8dc34e11801d8dda9b51286c, user_id=79bcc38a935748e49e1501ae31e49e51, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:18.864342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8100c8-f577-4b7f-92c0-7a4944b5e7be admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:18.923962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1106/2200] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:18 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:56:18.925149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278326a-d2dc-4d6f-b463-4c086aa18277 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:18.953740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1095/2201] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:18 2022] PUT /identity/v3/projects/55a8560d8dc34e11801d8dda9b51286c/users/79bcc38a935748e49e1501ae31e49e51/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:18.967488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29344-a543-471e-a869-901cd6857de8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:18.968110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29344-a543-471e-a869-901cd6857de8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:18.968494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29344-a543-471e-a869-901cd6857de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.003535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7ee29344-a543-471e-a869-901cd6857de8 None None] MFA Rules not processed for user `79bcc38a935748e49e1501ae31e49e51`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:19.005084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7ee29344-a543-471e-a869-901cd6857de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:19.056588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278326a-d2dc-4d6f-b463-4c086aa18277 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.096123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1096/2202] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:19.102548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee29344-a543-471e-a869-901cd6857de8 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.212500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c54f6-6349-4fc5-aeb7-0650f20cd311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.213345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee29344-a543-471e-a869-901cd6857de8 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.214898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c54f6-6349-4fc5-aeb7-0650f20cd311 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.215877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c54f6-6349-4fc5-aeb7-0650f20cd311 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.217020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c54f6-6349-4fc5-aeb7-0650f20cd311 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.220292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c54f6-6349-4fc5-aeb7-0650f20cd311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.227631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda7e5-989b-4bea-9333-0b08e33751a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.227631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda7e5-989b-4bea-9333-0b08e33751a3 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.227631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda7e5-989b-4bea-9333-0b08e33751a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.227631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda7e5-989b-4bea-9333-0b08e33751a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.228467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda7e5-989b-4bea-9333-0b08e33751a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.228467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda7e5-989b-4bea-9333-0b08e33751a3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.229233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c54f6-6349-4fc5-aeb7-0650f20cd311 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.329838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1097/2203] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:19 2022] POST /identity/v3/projects => generated 401 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:19.335448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda7e5-989b-4bea-9333-0b08e33751a3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.407262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1107/2204] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:18 2022] POST /identity/v3/users => generated 292 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:56:19.413630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c54f6-6349-4fc5-aeb7-0650f20cd311 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.416201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda7e5-989b-4bea-9333-0b08e33751a3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.426656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d1587-b0f4-4c3f-88d0-b7fc16363975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.427436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1587-b0f4-4c3f-88d0-b7fc16363975 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.428103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1587-b0f4-4c3f-88d0-b7fc16363975 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.428103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1587-b0f4-4c3f-88d0-b7fc16363975 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.428938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d1587-b0f4-4c3f-88d0-b7fc16363975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.431759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d1587-b0f4-4c3f-88d0-b7fc16363975 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.442775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c54f6-6349-4fc5-aeb7-0650f20cd311 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.455614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe63ce-2439-4438-b90c-f241cf232406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.457227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe63ce-2439-4438-b90c-f241cf232406 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.458002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe63ce-2439-4438-b90c-f241cf232406 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.458645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe63ce-2439-4438-b90c-f241cf232406 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.459604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe63ce-2439-4438-b90c-f241cf232406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.462197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe63ce-2439-4438-b90c-f241cf232406 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.483167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1108/2205] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:19.484489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe63ce-2439-4438-b90c-f241cf232406 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.498700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe63ce-2439-4438-b90c-f241cf232406 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.511964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54185b8d-fdab-4b89-b45f-5666a83a6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.512815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54185b8d-fdab-4b89-b45f-5666a83a6f8a admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.513113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54185b8d-fdab-4b89-b45f-5666a83a6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.513402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54185b8d-fdab-4b89-b45f-5666a83a6f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.514184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54185b8d-fdab-4b89-b45f-5666a83a6f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.516807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54185b8d-fdab-4b89-b45f-5666a83a6f8a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.534598 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1109/2206] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:19.538469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54185b8d-fdab-4b89-b45f-5666a83a6f8a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.551072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54185b8d-fdab-4b89-b45f-5666a83a6f8a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.552726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1098/2207] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:19 2022] POST /identity/v3/users => generated 307 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:56:19.557837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bcf27-c29c-4566-b2c4-6b60cf25749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.559060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcf27-c29c-4566-b2c4-6b60cf25749e admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.559515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcf27-c29c-4566-b2c4-6b60cf25749e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.559895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcf27-c29c-4566-b2c4-6b60cf25749e admin admin] PATH_INFO: `/v3/projects/37e26097b1954002ab53db8f4b19335b/users/a8abba42cecc47baa5e65c70a0d05dcd/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.561274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d1587-b0f4-4c3f-88d0-b7fc16363975 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.580343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d1587-b0f4-4c3f-88d0-b7fc16363975 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.589455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bcf27-c29c-4566-b2c4-6b60cf25749e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e26097b1954002ab53db8f4b19335b, user_id=a8abba42cecc47baa5e65c70a0d05dcd, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.592795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725a31e-db8c-4698-8051-b2e9a1e46c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.593935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725a31e-db8c-4698-8051-b2e9a1e46c98 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.594202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bcf27-c29c-4566-b2c4-6b60cf25749e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.594489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725a31e-db8c-4698-8051-b2e9a1e46c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.594773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725a31e-db8c-4698-8051-b2e9a1e46c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.595669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725a31e-db8c-4698-8051-b2e9a1e46c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.598137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725a31e-db8c-4698-8051-b2e9a1e46c98 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.609646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1099/2208] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:19.614971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725a31e-db8c-4698-8051-b2e9a1e46c98 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.625979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725a31e-db8c-4698-8051-b2e9a1e46c98 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.631895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ebd8-ffe5-45df-87c1-39f232c35769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.632784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ebd8-ffe5-45df-87c1-39f232c35769 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.633102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ebd8-ffe5-45df-87c1-39f232c35769 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.633408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ebd8-ffe5-45df-87c1-39f232c35769 admin admin] PATH_INFO: `/v3/projects/6095eea9c7174bbdbe70f3b19b129eb9/users/71f1c585b22d4f818cd7ee9c15795472/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.655053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ebd8-ffe5-45df-87c1-39f232c35769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6095eea9c7174bbdbe70f3b19b129eb9, user_id=71f1c585b22d4f818cd7ee9c15795472, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.658514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ebd8-ffe5-45df-87c1-39f232c35769 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.708980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1110/2209] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:19 2022] PUT /identity/v3/projects/37e26097b1954002ab53db8f4b19335b/users/a8abba42cecc47baa5e65c70a0d05dcd/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:19.720026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c232-4b47-4a82-976a-7751402cad45 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.721288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c232-4b47-4a82-976a-7751402cad45 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.721745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c232-4b47-4a82-976a-7751402cad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.767353 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1100/2210] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:19 2022] PUT /identity/v3/projects/6095eea9c7174bbdbe70f3b19b129eb9/users/71f1c585b22d4f818cd7ee9c15795472/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:19.773650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ebd8-ffe5-45df-87c1-39f232c35769 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.800472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1828c232-4b47-4a82-976a-7751402cad45 None None] MFA Rules not processed for user `a8abba42cecc47baa5e65c70a0d05dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:19.801636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1828c232-4b47-4a82-976a-7751402cad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:19.896066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:19.899836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ebd8-ffe5-45df-87c1-39f232c35769 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.905817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd78fba-041a-4b52-a9a6-1c54bb8280ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.906586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78fba-041a-4b52-a9a6-1c54bb8280ed admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.906882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78fba-041a-4b52-a9a6-1c54bb8280ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.907154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78fba-041a-4b52-a9a6-1c54bb8280ed admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.913426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd78fba-041a-4b52-a9a6-1c54bb8280ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.924872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1111/2211] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:19.932394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd78fba-041a-4b52-a9a6-1c54bb8280ed admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:19.947422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c232-4b47-4a82-976a-7751402cad45 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.948113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1101/2212] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:19.952129 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1828c232-4b47-4a82-976a-7751402cad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:19.955312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd78fba-041a-4b52-a9a6-1c54bb8280ed admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:19.976570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd78fba-041a-4b52-a9a6-1c54bb8280ed admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:19.985150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeb781-7d6c-44e8-ab6d-5489b6b1f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:19.986772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb781-7d6c-44e8-ab6d-5489b6b1f039 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:19.987270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb781-7d6c-44e8-ab6d-5489b6b1f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:19.987924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb781-7d6c-44e8-ab6d-5489b6b1f039 admin admin] PATH_INFO: `/v3/projects/6095eea9c7174bbdbe70f3b19b129eb9/users/71f1c585b22d4f818cd7ee9c15795472/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:19.994703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeb781-7d6c-44e8-ab6d-5489b6b1f039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6095eea9c7174bbdbe70f3b19b129eb9, user_id=71f1c585b22d4f818cd7ee9c15795472, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:19.998671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeb781-7d6c-44e8-ab6d-5489b6b1f039 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:20.015648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1102/2213] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:19 2022] PUT /identity/v3/projects/6095eea9c7174bbdbe70f3b19b129eb9/users/71f1c585b22d4f818cd7ee9c15795472/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:20.037928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeeb26-c793-4851-a4cb-ff9697ae4172 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:20.038520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeeb26-c793-4851-a4cb-ff9697ae4172 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:20.039055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeeb26-c793-4851-a4cb-ff9697ae4172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:20.074539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c232-4b47-4a82-976a-7751402cad45 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:20.086970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0dbeeb26-c793-4851-a4cb-ff9697ae4172 None None] MFA Rules not processed for user `71f1c585b22d4f818cd7ee9c15795472`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:20.095309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0dbeeb26-c793-4851-a4cb-ff9697ae4172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:20.117960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:20.161418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6833d6-65c9-40a5-bc69-90bb479bf970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:20.162309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6833d6-65c9-40a5-bc69-90bb479bf970 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:20.162695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6833d6-65c9-40a5-bc69-90bb479bf970 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:20.163072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6833d6-65c9-40a5-bc69-90bb479bf970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:20.250908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6833d6-65c9-40a5-bc69-90bb479bf970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:20.254857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6833d6-65c9-40a5-bc69-90bb479bf970 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:20.277172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1112/2214] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:20.287063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1103/2215] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:20.324796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6833d6-65c9-40a5-bc69-90bb479bf970 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:20.358516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6833d6-65c9-40a5-bc69-90bb479bf970 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:20.367892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:20.369017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:20.369489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:20.369963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:20.469100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:20.472767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:20.487907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1113/2216] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:20 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:20.561255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:20.762289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:22.425853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbeeb26-c793-4851-a4cb-ff9697ae4172 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:22.427049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0dbeeb26-c793-4851-a4cb-ff9697ae4172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:22.567363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbeeb26-c793-4851-a4cb-ff9697ae4172 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:22.573366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcc395-b5d4-45c4-85bd-8596a3bde3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:22.574231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcc395-b5d4-45c4-85bd-8596a3bde3ff service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:22.574627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcc395-b5d4-45c4-85bd-8596a3bde3ff service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:22.574999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcc395-b5d4-45c4-85bd-8596a3bde3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:22.590196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcc395-b5d4-45c4-85bd-8596a3bde3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:22.592456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcc395-b5d4-45c4-85bd-8596a3bde3ff service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:22.634560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1104/2217] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:26.831333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:26.833452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:26.975211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b973-ffcf-45fe-a893-f65e41cec87f service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:26.988364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:26.990306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:26.990605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:26.990886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] PATH_INFO: `/v3/users/6e5b57e7f1b9495ba481a66c646939f5` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:26.992452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5b57e7f1b9495ba481a66c646939f5)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:26.994836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:27.249320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5b57e7f1b9495ba481a66c646939f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:27.372095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5b57e7f1b9495ba481a66c646939f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:27.415645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5b57e7f1b9495ba481a66c646939f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:27.431876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5b57e7f1b9495ba481a66c646939f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:27.432689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5b57e7f1b9495ba481a66c646939f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:27.451399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1114/2218] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:26 2022] DELETE /identity/v3/users/6e5b57e7f1b9495ba481a66c646939f5 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:27.456043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243e4e-c353-403a-9722-5a56c38d907e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:27.457109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243e4e-c353-403a-9722-5a56c38d907e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:27.457236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243e4e-c353-403a-9722-5a56c38d907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:27.504942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c9243e4e-c353-403a-9722-5a56c38d907e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:27.506401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c9243e4e-c353-403a-9722-5a56c38d907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:27.670356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1105/2219] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:27.771002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:27.773423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:27.866135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:27.901054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410dbfd-b2ed-4c40-8adb-473ceba7686f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:27.911313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58898-472e-4c36-99d2-25df28b7820d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:27.912254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58898-472e-4c36-99d2-25df28b7820d service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:27.912700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58898-472e-4c36-99d2-25df28b7820d service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:27.913150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58898-472e-4c36-99d2-25df28b7820d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:27.927930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58898-472e-4c36-99d2-25df28b7820d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:27.929806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58898-472e-4c36-99d2-25df28b7820d service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:27.945445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1115/2220] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:28.689648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9243e4e-c353-403a-9722-5a56c38d907e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:28.716906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c9243e4e-c353-403a-9722-5a56c38d907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:28.821553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9243e4e-c353-403a-9722-5a56c38d907e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:28.828895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:28.829773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:28.830302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:28.830751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] PATH_INFO: `/v3/projects/475700144b0f4f70ac8b803db620eccb` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:28.843109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475700144b0f4f70ac8b803db620eccb)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:28.845300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:28.976805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:28.988834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475700144b0f4f70ac8b803db620eccb', 'request_id': 'req-485982fa-c768-4a64-8304-9c2edce30564'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:29.081695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475700144b0f4f70ac8b803db620eccb', 'request_id': 'req-485982fa-c768-4a64-8304-9c2edce30564'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:29.090540 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475700144b0f4f70ac8b803db620eccb', 'request_id': 'req-485982fa-c768-4a64-8304-9c2edce30564'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:29.118050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] The token cache is being invalidate because project 475700144b0f4f70ac8b803db620eccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:29.118396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:29.121249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-485982fa-c768-4a64-8304-9c2edce30564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:29.126220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1106/2221] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:28 2022] DELETE /identity/v3/projects/475700144b0f4f70ac8b803db620eccb => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:29.127670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde6144-9b7c-457a-89db-7e9a7300b9ec None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:29.128554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde6144-9b7c-457a-89db-7e9a7300b9ec None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:29.129023 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde6144-9b7c-457a-89db-7e9a7300b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:29.154032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9bde6144-9b7c-457a-89db-7e9a7300b9ec None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:29.155271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9bde6144-9b7c-457a-89db-7e9a7300b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:29.253426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1116/2222] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:29.255934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9825b9-f2f6-43a4-86f6-8be2de52cb62 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:29.256429 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9825b9-f2f6-43a4-86f6-8be2de52cb62 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:29.256867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9825b9-f2f6-43a4-86f6-8be2de52cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:29.282960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4b9825b9-f2f6-43a4-86f6-8be2de52cb62 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:29.285316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4b9825b9-f2f6-43a4-86f6-8be2de52cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:29.312210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1107/2223] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:29.317933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde6144-9b7c-457a-89db-7e9a7300b9ec None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:29.334165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde6144-9b7c-457a-89db-7e9a7300b9ec None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:29.351670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:29.353341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:29.353606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:29.353894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:29.354741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:29.355840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:29.357892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:29.377538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1117/2224] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:56:29.379888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9825b9-f2f6-43a4-86f6-8be2de52cb62 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:29.403906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9825b9-f2f6-43a4-86f6-8be2de52cb62 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:29.418769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a7357-1a52-436b-bfbc-815b475dd044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:29.419982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7357-1a52-436b-bfbc-815b475dd044 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:29.419982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7357-1a52-436b-bfbc-815b475dd044 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:29.419982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7357-1a52-436b-bfbc-815b475dd044 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:29.425435 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a7357-1a52-436b-bfbc-815b475dd044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:29.429083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a7357-1a52-436b-bfbc-815b475dd044 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:29.585554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1108/2225] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:29 2022] POST /identity/v3/projects => generated 359 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:29.592234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:29.639641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18673-2f10-4463-94b5-f22eb5a07d50 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:29.759297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebb811-c290-4315-ad80-af50137070b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:29.760504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb811-c290-4315-ad80-af50137070b9 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:29.761163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb811-c290-4315-ad80-af50137070b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:29.761704 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb811-c290-4315-ad80-af50137070b9 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:29.762566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebb811-c290-4315-ad80-af50137070b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:29.765712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebb811-c290-4315-ad80-af50137070b9 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:29.877354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1118/2226] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:29 2022] POST /identity/v3/users => generated 280 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:29.882060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a7357-1a52-436b-bfbc-815b475dd044 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:29.914634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a7357-1a52-436b-bfbc-815b475dd044 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:29.930807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47863-1576-430a-bf04-4807be2d679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:29.933624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47863-1576-430a-bf04-4807be2d679d admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:29.933624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47863-1576-430a-bf04-4807be2d679d admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:29.933624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47863-1576-430a-bf04-4807be2d679d admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:29.935978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47863-1576-430a-bf04-4807be2d679d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:29.938636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47863-1576-430a-bf04-4807be2d679d admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:29.966397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1109/2227] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:29.971697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebb811-c290-4315-ad80-af50137070b9 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:29.996442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebb811-c290-4315-ad80-af50137070b9 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:30.003327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3e01a-5d84-4850-ba7a-83bb3b1f3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:30.004497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e01a-5d84-4850-ba7a-83bb3b1f3f7c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:30.005039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e01a-5d84-4850-ba7a-83bb3b1f3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:30.005961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e01a-5d84-4850-ba7a-83bb3b1f3f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:30.006418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3e01a-5d84-4850-ba7a-83bb3b1f3f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:30.008204 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3e01a-5d84-4850-ba7a-83bb3b1f3f7c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:30.022495 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1119/2228] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:30.027280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47863-1576-430a-bf04-4807be2d679d admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:30.041580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47863-1576-430a-bf04-4807be2d679d admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:30.048293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:30.049440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:30.049727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:30.050077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] PATH_INFO: `/v3/projects/49ad271cd2574e48970ccd4b0faa2ec2/users/6e09b1e3c3e2413685b0d6d601d06eb9/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:30.086303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ad271cd2574e48970ccd4b0faa2ec2, user_id=6e09b1e3c3e2413685b0d6d601d06eb9, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:30.089770 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:30.185419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1110/2229] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:30 2022] PUT /identity/v3/projects/49ad271cd2574e48970ccd4b0faa2ec2/users/6e09b1e3c3e2413685b0d6d601d06eb9/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:30.196964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b28bf6-3f63-44fe-9042-495269c15d1d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:30.197817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b28bf6-3f63-44fe-9042-495269c15d1d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:30.198302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b28bf6-3f63-44fe-9042-495269c15d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:30.232922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-42b28bf6-3f63-44fe-9042-495269c15d1d None None] MFA Rules not processed for user `6e09b1e3c3e2413685b0d6d601d06eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:30.236015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-42b28bf6-3f63-44fe-9042-495269c15d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:30.277898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:30.316014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1120/2230] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:30.354207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:30.356447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:30.491593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132fb4d-da0e-47d3-9285-39c4379e4d3d admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:30.503723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c388-e115-40d5-86f4-7481df681323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:30.504855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c388-e115-40d5-86f4-7481df681323 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:30.505744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c388-e115-40d5-86f4-7481df681323 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:30.506331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c388-e115-40d5-86f4-7481df681323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:30.530719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c388-e115-40d5-86f4-7481df681323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:30.532212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c388-e115-40d5-86f4-7481df681323 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:30.544104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1111/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:36.855153 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b28bf6-3f63-44fe-9042-495269c15d1d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:36.856683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-42b28bf6-3f63-44fe-9042-495269c15d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:37.005733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b28bf6-3f63-44fe-9042-495269c15d1d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:37.011069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:37.012217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:37.012674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:37.013432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] PATH_INFO: `/v3/users/a8abba42cecc47baa5e65c70a0d05dcd` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:37.023051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8abba42cecc47baa5e65c70a0d05dcd)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:37.025970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:37.651720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8abba42cecc47baa5e65c70a0d05dcd'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:37.778001 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8abba42cecc47baa5e65c70a0d05dcd'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:37.800071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8abba42cecc47baa5e65c70a0d05dcd'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:37.810653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8abba42cecc47baa5e65c70a0d05dcd'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:37.811608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8abba42cecc47baa5e65c70a0d05dcd'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:37.826864 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1121/2232] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:36 2022] DELETE /identity/v3/users/a8abba42cecc47baa5e65c70a0d05dcd => generated 0 bytes in 967 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:37.827383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3acf-079e-4bdc-8c4f-372711afcf53 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:37.827863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3acf-079e-4bdc-8c4f-372711afcf53 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:37.827973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3acf-079e-4bdc-8c4f-372711afcf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:37.858657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-e50a3acf-079e-4bdc-8c4f-372711afcf53 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:37.862265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e50a3acf-079e-4bdc-8c4f-372711afcf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:37.968026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1112/2233] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:37.989142 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:37.995103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:38.115415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18532761-61ab-4aac-8a1e-62b0a86f0635 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:38.120980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:38.124464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:38.124931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:38.125377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:38.138700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:38.143276 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:38.145668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:38.163321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1122/2234] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:39.086254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3acf-079e-4bdc-8c4f-372711afcf53 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:39.089385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e50a3acf-079e-4bdc-8c4f-372711afcf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.104979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3acf-079e-4bdc-8c4f-372711afcf53 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:39.109235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:39.111919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.117645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:39.117645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.117645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.117645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] PATH_INFO: `/v3/projects/37e26097b1954002ab53db8f4b19335b` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.119584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e26097b1954002ab53db8f4b19335b)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:39.121720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:39.123794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:39.128279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03dcf-b721-4926-b480-fe9cbf179230 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:39.133927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:39.135090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.135588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.136122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] PATH_INFO: `/v3/users/bc5d68bdba3643d18c561440b584777a` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.137576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5d68bdba3643d18c561440b584777a)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:39.140354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:39.297584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e26097b1954002ab53db8f4b19335b', 'request_id': 'req-6e77ccb4-54d2-421b-8681-2c242ecdaf10'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.395907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e26097b1954002ab53db8f4b19335b', 'request_id': 'req-6e77ccb4-54d2-421b-8681-2c242ecdaf10'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.408979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e26097b1954002ab53db8f4b19335b', 'request_id': 'req-6e77ccb4-54d2-421b-8681-2c242ecdaf10'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.427174 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] The token cache is being invalidate because project 37e26097b1954002ab53db8f4b19335b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:39.432035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.432035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.438568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1113/2235] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:39 2022] DELETE /identity/v3/projects/37e26097b1954002ab53db8f4b19335b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:39.440981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:39.447042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.449577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5d68bdba3643d18c561440b584777a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.576235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77ccb4-54d2-421b-8681-2c242ecdaf10 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:39.581674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:39.582628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.582907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.583180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] PATH_INFO: `/v3/users/adfc1008b8da4949a8c8c9343cfd2ea9` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.584417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfc1008b8da4949a8c8c9343cfd2ea9)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:39.586402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:39.617730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5d68bdba3643d18c561440b584777a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.637685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5d68bdba3643d18c561440b584777a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.647622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5d68bdba3643d18c561440b584777a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.648629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e3fd5f2c-fb17-4939-bfbc-48af0ff29175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5d68bdba3643d18c561440b584777a'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.657573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1123/2236] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:39 2022] DELETE /identity/v3/users/bc5d68bdba3643d18c561440b584777a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:39.659979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dee6d-c056-44e8-8dde-177b6d07ca3e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.660504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dee6d-c056-44e8-8dde-177b6d07ca3e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.661097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dee6d-c056-44e8-8dde-177b6d07ca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.686064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4e6dee6d-c056-44e8-8dde-177b6d07ca3e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:39.690452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4e6dee6d-c056-44e8-8dde-177b6d07ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.789784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1124/2237] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:39.789784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2825-5e2d-480b-9b06-c378d2d22dd4 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.789784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2825-5e2d-480b-9b06-c378d2d22dd4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.789784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2825-5e2d-480b-9b06-c378d2d22dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.800167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfc1008b8da4949a8c8c9343cfd2ea9'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.816012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-da7b2825-5e2d-480b-9b06-c378d2d22dd4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:39.817389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-da7b2825-5e2d-480b-9b06-c378d2d22dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.826137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1125/2238] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:39.829688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e17b1-57d9-4a5d-b4ee-fc70c87ad919 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.829688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e17b1-57d9-4a5d-b4ee-fc70c87ad919 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.829688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e17b1-57d9-4a5d-b4ee-fc70c87ad919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.851947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-195e17b1-57d9-4a5d-b4ee-fc70c87ad919 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:39.853625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-195e17b1-57d9-4a5d-b4ee-fc70c87ad919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.857684 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfc1008b8da4949a8c8c9343cfd2ea9'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.870756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1126/2239] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:39.870756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e17b1-57d9-4a5d-b4ee-fc70c87ad919 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:39.870756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-195e17b1-57d9-4a5d-b4ee-fc70c87ad919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.884986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfc1008b8da4949a8c8c9343cfd2ea9'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.887389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfc1008b8da4949a8c8c9343cfd2ea9'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.901653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfc1008b8da4949a8c8c9343cfd2ea9'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.911380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1114/2240] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:39 2022] DELETE /identity/v3/users/adfc1008b8da4949a8c8c9343cfd2ea9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:39.912373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:39.914645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.963191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e17b1-57d9-4a5d-b4ee-fc70c87ad919 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:39.972782 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:40.004361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf789ac-ea8a-41d4-bacc-be9384106dde admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.010299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7184bc-be00-42cc-a59b-431f4c06f5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.011458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7184bc-be00-42cc-a59b-431f4c06f5db admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.011755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7184bc-be00-42cc-a59b-431f4c06f5db admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.012359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7184bc-be00-42cc-a59b-431f4c06f5db admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.013102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7184bc-be00-42cc-a59b-431f4c06f5db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:40.013418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7184bc-be00-42cc-a59b-431f4c06f5db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.015114 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7184bc-be00-42cc-a59b-431f4c06f5db admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.020358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.021117 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.021548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.021899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.023790 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.030654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1115/2241] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:40.032512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ccdb-039c-4806-a842-1cbba3733f77 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.033185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ccdb-039c-4806-a842-1cbba3733f77 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.033323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ccdb-039c-4806-a842-1cbba3733f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.041152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.042635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.053517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1127/2242] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:40.054296 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.061265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4221ccdb-039c-4806-a842-1cbba3733f77 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:40.063836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482f3f-9344-4eb1-847f-5ba4771181e0 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.071562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4221ccdb-039c-4806-a842-1cbba3733f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.071823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc0cd-8935-484f-9ceb-903fe50ae95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.072660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc0cd-8935-484f-9ceb-903fe50ae95d admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.078432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc0cd-8935-484f-9ceb-903fe50ae95d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.079376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc0cd-8935-484f-9ceb-903fe50ae95d admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.085243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc0cd-8935-484f-9ceb-903fe50ae95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.087295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc0cd-8935-484f-9ceb-903fe50ae95d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.105395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1116/2243] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:40.128602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221ccdb-039c-4806-a842-1cbba3733f77 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.130335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4221ccdb-039c-4806-a842-1cbba3733f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.152547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221ccdb-039c-4806-a842-1cbba3733f77 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.159204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38549d7-2f65-4ecf-a081-d1bbe1ca94a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.160372 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38549d7-2f65-4ecf-a081-d1bbe1ca94a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.160663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38549d7-2f65-4ecf-a081-d1bbe1ca94a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.160946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38549d7-2f65-4ecf-a081-d1bbe1ca94a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.195643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38549d7-2f65-4ecf-a081-d1bbe1ca94a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.198201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38549d7-2f65-4ecf-a081-d1bbe1ca94a4 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.229519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1128/2244] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/projects => generated 389 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:40.230983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1117/2245] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:40.233185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc0cd-8935-484f-9ceb-903fe50ae95d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.352867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc0cd-8935-484f-9ceb-903fe50ae95d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.359741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385999c9-2f73-4ab3-b8f1-54997df97799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.360447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385999c9-2f73-4ab3-b8f1-54997df97799 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.360736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385999c9-2f73-4ab3-b8f1-54997df97799 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.361015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385999c9-2f73-4ab3-b8f1-54997df97799 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.362697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385999c9-2f73-4ab3-b8f1-54997df97799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.366421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385999c9-2f73-4ab3-b8f1-54997df97799 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.481177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1129/2246] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:56:40.482733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38549d7-2f65-4ecf-a081-d1bbe1ca94a4 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.495799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38549d7-2f65-4ecf-a081-d1bbe1ca94a4 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.502786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04a056-4b9f-4b22-bde2-a258a3ac514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.503632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a056-4b9f-4b22-bde2-a258a3ac514c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.504018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a056-4b9f-4b22-bde2-a258a3ac514c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.504890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a056-4b9f-4b22-bde2-a258a3ac514c admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.505745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04a056-4b9f-4b22-bde2-a258a3ac514c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.508738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04a056-4b9f-4b22-bde2-a258a3ac514c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.529696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1118/2247] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:40.531302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385999c9-2f73-4ab3-b8f1-54997df97799 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.563402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385999c9-2f73-4ab3-b8f1-54997df97799 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.571439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.572486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.573206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.573593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.575372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.578030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.597300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1130/2248] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:40.601166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04a056-4b9f-4b22-bde2-a258a3ac514c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.612582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04a056-4b9f-4b22-bde2-a258a3ac514c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.618549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff5a5-10b2-4702-9b6a-3bda228115a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.620060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff5a5-10b2-4702-9b6a-3bda228115a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.620443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff5a5-10b2-4702-9b6a-3bda228115a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.620817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff5a5-10b2-4702-9b6a-3bda228115a1 admin admin] PATH_INFO: `/v3/projects/5c33bb9acaeb4e4dbc8207aa15bf6676/users/13011e0bc7784d6b92e8683009d13436/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.638742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ff5a5-10b2-4702-9b6a-3bda228115a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c33bb9acaeb4e4dbc8207aa15bf6676, user_id=13011e0bc7784d6b92e8683009d13436, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.641368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ff5a5-10b2-4702-9b6a-3bda228115a1 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.689715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.691776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.714155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1119/2249] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:40 2022] PUT /identity/v3/projects/5c33bb9acaeb4e4dbc8207aa15bf6676/users/13011e0bc7784d6b92e8683009d13436/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:40.725389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8af4-08cc-4cd4-a52e-3796885b8f83 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.725501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8af4-08cc-4cd4-a52e-3796885b8f83 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.726557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8af4-08cc-4cd4-a52e-3796885b8f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.734058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67a7d2-9245-4edc-9bf2-edcd83835113 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.761393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:40.798221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c25f8af4-08cc-4cd4-a52e-3796885b8f83 None None] MFA Rules not processed for user `13011e0bc7784d6b92e8683009d13436`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:40.800714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c25f8af4-08cc-4cd4-a52e-3796885b8f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.865501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.867080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.867474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.869675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] PATH_INFO: `/v3/projects/72f7168567a4453f8bf639b237323b22` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.871755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f7168567a4453f8bf639b237323b22)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.874763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.895395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1120/2250] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:40.914789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f8af4-08cc-4cd4-a52e-3796885b8f83 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.917212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c25f8af4-08cc-4cd4-a52e-3796885b8f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:41.026826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f7168567a4453f8bf639b237323b22', 'request_id': 'req-f38867b6-4210-440f-8496-1a459bf2bf9c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.033506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f8af4-08cc-4cd4-a52e-3796885b8f83 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.103623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f7168567a4453f8bf639b237323b22', 'request_id': 'req-f38867b6-4210-440f-8496-1a459bf2bf9c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.104762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.105641 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.106273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.106273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.121233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f7168567a4453f8bf639b237323b22', 'request_id': 'req-f38867b6-4210-440f-8496-1a459bf2bf9c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.140208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] The token cache is being invalidate because project 72f7168567a4453f8bf639b237323b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:41.140754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.141635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.145364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1131/2251] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:40 2022] DELETE /identity/v3/projects/72f7168567a4453f8bf639b237323b22 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:41.147833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:41.148905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:41.186547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.188830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.200898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1121/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:41.202078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:41.203690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:41.263155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38867b6-4210-440f-8496-1a459bf2bf9c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.269144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.270381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.270928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.271376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] PATH_INFO: `/v3/projects/58b68ec62c50448e959c91d86ec2e487` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.273445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b68ec62c50448e959c91d86ec2e487)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.275725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.280449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1d501-74e4-4b4b-b795-1ee38d2983b3 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.285409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.286250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.286529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.286988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] PATH_INFO: `/v3/users/79bcc38a935748e49e1501ae31e49e51` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.288493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bcc38a935748e49e1501ae31e49e51)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.291054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.355951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:41.516335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b68ec62c50448e959c91d86ec2e487', 'request_id': 'req-6ee8352e-84dd-4f07-8062-537ba0507915'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.517101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bcc38a935748e49e1501ae31e49e51'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.669450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b68ec62c50448e959c91d86ec2e487', 'request_id': 'req-6ee8352e-84dd-4f07-8062-537ba0507915'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.677839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b68ec62c50448e959c91d86ec2e487', 'request_id': 'req-6ee8352e-84dd-4f07-8062-537ba0507915'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.689566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] The token cache is being invalidate because project 58b68ec62c50448e959c91d86ec2e487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:41.689868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.690993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6ee8352e-84dd-4f07-8062-537ba0507915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.697280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1132/2253] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:41 2022] DELETE /identity/v3/projects/58b68ec62c50448e959c91d86ec2e487 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:41.706239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad015a-d520-4046-a054-c68415f6bb68 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.706958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad015a-d520-4046-a054-c68415f6bb68 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.707594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad015a-d520-4046-a054-c68415f6bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.757317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f7ad015a-d520-4046-a054-c68415f6bb68 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:41.762629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f7ad015a-d520-4046-a054-c68415f6bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:41.766522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bcc38a935748e49e1501ae31e49e51'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.787686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bcc38a935748e49e1501ae31e49e51'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.788503 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bcc38a935748e49e1501ae31e49e51'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.803797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-60740e85-5ac6-4d23-b24a-6c15bde3433a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bcc38a935748e49e1501ae31e49e51'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:41.818325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1122/2254] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:41 2022] DELETE /identity/v3/users/79bcc38a935748e49e1501ae31e49e51 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:41.819627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3272be-b834-4347-98eb-935074571bc8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.820023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3272be-b834-4347-98eb-935074571bc8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.820405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3272be-b834-4347-98eb-935074571bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.848414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-de3272be-b834-4347-98eb-935074571bc8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:41.854397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-de3272be-b834-4347-98eb-935074571bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:41.892184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1133/2255] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:41.893876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2983b1a-c68b-4ab8-84f4-ac06cba95f52 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.894720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2983b1a-c68b-4ab8-84f4-ac06cba95f52 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.894720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2983b1a-c68b-4ab8-84f4-ac06cba95f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.915433 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c2983b1a-c68b-4ab8-84f4-ac06cba95f52 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:41.916658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c2983b1a-c68b-4ab8-84f4-ac06cba95f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:41.944419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1123/2256] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:41.946314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8176-7b90-4790-a058-68d83d04a8f5 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.946796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8176-7b90-4790-a058-68d83d04a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.947259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8176-7b90-4790-a058-68d83d04a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.979541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0b2b8176-7b90-4790-a058-68d83d04a8f5 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:41.980802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0b2b8176-7b90-4790-a058-68d83d04a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:41.992848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1124/2257] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:41.994291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1db4-9d22-4e2b-8666-41f30bed50cd None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.994634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1db4-9d22-4e2b-8666-41f30bed50cd None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.994913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1db4-9d22-4e2b-8666-41f30bed50cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.007616 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1134/2258] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:42.008582 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2983b1a-c68b-4ab8-84f4-ac06cba95f52 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.017127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c58a1db4-9d22-4e2b-8666-41f30bed50cd None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:42.019013 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c58a1db4-9d22-4e2b-8666-41f30bed50cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:42.021899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2983b1a-c68b-4ab8-84f4-ac06cba95f52 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.027452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.028127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.028561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1125/2259] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:42.031463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.031724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.032338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:42.034200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.034348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1db4-9d22-4e2b-8666-41f30bed50cd None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.035633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c58a1db4-9d22-4e2b-8666-41f30bed50cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:42.036443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.054961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1135/2260] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:42.060094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.073625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73299024-18e8-49ee-9375-9d935c6731e1 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.079418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.086558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.086558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.086558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.086558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:42.086558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.086558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.105615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1136/2261] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:42.107402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.121600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1db4-9d22-4e2b-8666-41f30bed50cd None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.124090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afccfb7-800b-49cd-bbdd-40624741ba4c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.127770 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75ec5-20b1-4e3b-8825-d5e310e8adce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.128573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75ec5-20b1-4e3b-8825-d5e310e8adce service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.128982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75ec5-20b1-4e3b-8825-d5e310e8adce service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.129297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75ec5-20b1-4e3b-8825-d5e310e8adce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.131430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482384-c113-445d-abd7-fe9a761f0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.132527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482384-c113-445d-abd7-fe9a761f0f37 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.132869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482384-c113-445d-abd7-fe9a761f0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.133248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482384-c113-445d-abd7-fe9a761f0f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.134046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30482384-c113-445d-abd7-fe9a761f0f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.137026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30482384-c113-445d-abd7-fe9a761f0f37 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.141109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e75ec5-20b1-4e3b-8825-d5e310e8adce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.143379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e75ec5-20b1-4e3b-8825-d5e310e8adce service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.155912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1126/2262] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:42.157483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75ec5-20b1-4e3b-8825-d5e310e8adce service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.168846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75ec5-20b1-4e3b-8825-d5e310e8adce service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.175525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e47577-1719-4e48-ad88-9e85e666d42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.176808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e47577-1719-4e48-ad88-9e85e666d42f admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.177324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e47577-1719-4e48-ad88-9e85e666d42f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.177901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e47577-1719-4e48-ad88-9e85e666d42f admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.178817 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e47577-1719-4e48-ad88-9e85e666d42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.181026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e47577-1719-4e48-ad88-9e85e666d42f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.242740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1137/2263] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:42 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:42.247528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482384-c113-445d-abd7-fe9a761f0f37 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.305506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:42.317892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1127/2264] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:42 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:42.319081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482384-c113-445d-abd7-fe9a761f0f37 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.319577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e47577-1719-4e48-ad88-9e85e666d42f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.399101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246af00c-ad90-417d-98f2-5dfca5a73141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.400229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246af00c-ad90-417d-98f2-5dfca5a73141 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.400878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246af00c-ad90-417d-98f2-5dfca5a73141 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.401423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246af00c-ad90-417d-98f2-5dfca5a73141 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.402528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246af00c-ad90-417d-98f2-5dfca5a73141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.405207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246af00c-ad90-417d-98f2-5dfca5a73141 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.405943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e47577-1719-4e48-ad88-9e85e666d42f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.411974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c149-1577-4b7c-a054-9b7c8ca74880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.412672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c149-1577-4b7c-a054-9b7c8ca74880 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.412955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c149-1577-4b7c-a054-9b7c8ca74880 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.413244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c149-1577-4b7c-a054-9b7c8ca74880 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.414091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58c149-1577-4b7c-a054-9b7c8ca74880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.416294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58c149-1577-4b7c-a054-9b7c8ca74880 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.446601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:42.516746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1138/2265] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:42 2022] POST /identity/v3/users => generated 284 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:42.519018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246af00c-ad90-417d-98f2-5dfca5a73141 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.529430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246af00c-ad90-417d-98f2-5dfca5a73141 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.539912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1128/2266] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:42 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:56:42.543986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a89472-68a3-43cb-add4-7ca10a1e6b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.544672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a89472-68a3-43cb-add4-7ca10a1e6b30 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.544952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a89472-68a3-43cb-add4-7ca10a1e6b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.546215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c149-1577-4b7c-a054-9b7c8ca74880 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.552117 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a89472-68a3-43cb-add4-7ca10a1e6b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.553529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a89472-68a3-43cb-add4-7ca10a1e6b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.554589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a89472-68a3-43cb-add4-7ca10a1e6b30 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.561585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c149-1577-4b7c-a054-9b7c8ca74880 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.572185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1139/2267] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:42.572842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4560-d423-4528-8070-278b5a0af743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.573531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4560-d423-4528-8070-278b5a0af743 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.573811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4560-d423-4528-8070-278b5a0af743 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.574087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4560-d423-4528-8070-278b5a0af743 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.575119 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4560-d423-4528-8070-278b5a0af743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.576020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a89472-68a3-43cb-add4-7ca10a1e6b30 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.576654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4560-d423-4528-8070-278b5a0af743 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.587185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a89472-68a3-43cb-add4-7ca10a1e6b30 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.589832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1129/2268] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:42.594636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4560-d423-4528-8070-278b5a0af743 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.595431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5c6a9-10c9-4816-8e39-ed89c84c4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.596886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5c6a9-10c9-4816-8e39-ed89c84c4ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.601233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5c6a9-10c9-4816-8e39-ed89c84c4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.601233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5c6a9-10c9-4816-8e39-ed89c84c4ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.601233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5c6a9-10c9-4816-8e39-ed89c84c4ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.601233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5c6a9-10c9-4816-8e39-ed89c84c4ce0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.610846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4560-d423-4528-8070-278b5a0af743 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.616114 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1140/2269] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:42.617119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5c6a9-10c9-4816-8e39-ed89c84c4ce0 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.622966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf19e-57eb-4e86-ba82-5ddbc5b2ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.623996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf19e-57eb-4e86-ba82-5ddbc5b2ced9 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.624480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf19e-57eb-4e86-ba82-5ddbc5b2ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.625799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf19e-57eb-4e86-ba82-5ddbc5b2ced9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.627113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baf19e-57eb-4e86-ba82-5ddbc5b2ced9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.628565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5c6a9-10c9-4816-8e39-ed89c84c4ce0 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.631449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baf19e-57eb-4e86-ba82-5ddbc5b2ced9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.635037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d943bc-7f83-47f5-9391-5bdca42d3114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.635511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d943bc-7f83-47f5-9391-5bdca42d3114 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.635858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d943bc-7f83-47f5-9391-5bdca42d3114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.636216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d943bc-7f83-47f5-9391-5bdca42d3114 admin admin] PATH_INFO: `/v3/projects/78cc4792e4b94256a71ad776fad630ab/users/d8855248a97d43148e8702065ee62565/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.657022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d943bc-7f83-47f5-9391-5bdca42d3114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cc4792e4b94256a71ad776fad630ab, user_id=d8855248a97d43148e8702065ee62565, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.657135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1130/2270] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:42.657230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d943bc-7f83-47f5-9391-5bdca42d3114 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.660253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf19e-57eb-4e86-ba82-5ddbc5b2ced9 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.673333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf19e-57eb-4e86-ba82-5ddbc5b2ced9 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.679875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5773b-1c64-4abb-9fb0-277663efa726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.681584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5773b-1c64-4abb-9fb0-277663efa726 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.682326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5773b-1c64-4abb-9fb0-277663efa726 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.683181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5773b-1c64-4abb-9fb0-277663efa726 admin admin] PATH_INFO: `/v3/projects/9127b54157534e838fb68568960be749/users/5d13a03003314d28bb2919284108ca37/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.701066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5773b-1c64-4abb-9fb0-277663efa726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9127b54157534e838fb68568960be749, user_id=5d13a03003314d28bb2919284108ca37, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.704211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5773b-1c64-4abb-9fb0-277663efa726 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.761798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1141/2271] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:42 2022] PUT /identity/v3/projects/78cc4792e4b94256a71ad776fad630ab/users/d8855248a97d43148e8702065ee62565/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:42.768829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437628-3f9f-44ad-84a1-0e54bd1e7a4e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.769128 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437628-3f9f-44ad-84a1-0e54bd1e7a4e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.769566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437628-3f9f-44ad-84a1-0e54bd1e7a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.796218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1131/2272] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:42 2022] PUT /identity/v3/projects/9127b54157534e838fb68568960be749/users/5d13a03003314d28bb2919284108ca37/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:42.797919 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfef4d-c83c-4392-9fc8-092342f50c4a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.798522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfef4d-c83c-4392-9fc8-092342f50c4a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.799043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfef4d-c83c-4392-9fc8-092342f50c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.814604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-8f437628-3f9f-44ad-84a1-0e54bd1e7a4e None None] MFA Rules not processed for user `d8855248a97d43148e8702065ee62565`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:42.816310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8f437628-3f9f-44ad-84a1-0e54bd1e7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:42.843843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-25dfef4d-c83c-4392-9fc8-092342f50c4a None None] MFA Rules not processed for user `5d13a03003314d28bb2919284108ca37`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:42.845266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-25dfef4d-c83c-4392-9fc8-092342f50c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:42.928636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1142/2273] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:42.941487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f437628-3f9f-44ad-84a1-0e54bd1e7a4e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.942843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8f437628-3f9f-44ad-84a1-0e54bd1e7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:42.942951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1132/2274] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:42.952998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfef4d-c83c-4392-9fc8-092342f50c4a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.954381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-25dfef4d-c83c-4392-9fc8-092342f50c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:43.004538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f437628-3f9f-44ad-84a1-0e54bd1e7a4e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:43.008393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:43.009077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:43.009398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:43.009681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:43.018515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfef4d-c83c-4392-9fc8-092342f50c4a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:43.018843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:43.020285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:43.022243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5310-6981-4b97-9b90-6177dcce96a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:43.022887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5310-6981-4b97-9b90-6177dcce96a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:43.023167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5310-6981-4b97-9b90-6177dcce96a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:43.023443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5310-6981-4b97-9b90-6177dcce96a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:43.034239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1143/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:43.041607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:43.043174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:43.047971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc5310-6981-4b97-9b90-6177dcce96a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:43.049637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc5310-6981-4b97-9b90-6177dcce96a0 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:43.062859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1133/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:43.143786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047381d8-c069-49f2-8b27-c364e9ba40e7 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:43.150345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:43.151314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:43.151699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:43.152072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] PATH_INFO: `/v3/projects/55a8560d8dc34e11801d8dda9b51286c` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:43.153441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a8560d8dc34e11801d8dda9b51286c)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:43.155692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:43.271104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:43.348375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a8560d8dc34e11801d8dda9b51286c', 'request_id': 'req-694cbc2c-9225-4317-8f2f-73ab90cf2350'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:43.471742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a8560d8dc34e11801d8dda9b51286c', 'request_id': 'req-694cbc2c-9225-4317-8f2f-73ab90cf2350'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:43.493821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a8560d8dc34e11801d8dda9b51286c', 'request_id': 'req-694cbc2c-9225-4317-8f2f-73ab90cf2350'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:43.521171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] The token cache is being invalidate because project 55a8560d8dc34e11801d8dda9b51286c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:43.521369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:43.522056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:43.525570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1144/2277] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:43 2022] DELETE /identity/v3/projects/55a8560d8dc34e11801d8dda9b51286c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:43.529059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5310-6981-4b97-9b90-6177dcce96a0 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:43.541137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5310-6981-4b97-9b90-6177dcce96a0 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:43.607987 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:43.609189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:43.609773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:43.610354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] PATH_INFO: `/v3/users/71f1c585b22d4f818cd7ee9c15795472` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:43.613108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f1c585b22d4f818cd7ee9c15795472)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:43.616100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:43.903630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f1c585b22d4f818cd7ee9c15795472'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:43.978647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:44.029264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f1c585b22d4f818cd7ee9c15795472'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.047959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f1c585b22d4f818cd7ee9c15795472'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.050868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f1c585b22d4f818cd7ee9c15795472'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.061139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0818cae8-e5d9-40f4-951a-ed2f6a96b754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f1c585b22d4f818cd7ee9c15795472'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.068771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1134/2278] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:43 2022] DELETE /identity/v3/users/71f1c585b22d4f818cd7ee9c15795472 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:44.795619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:44.797674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:44.825579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbc2c-9225-4317-8f2f-73ab90cf2350 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:44.926261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:44.928421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:44.928766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:44.929190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] PATH_INFO: `/v3/projects/6095eea9c7174bbdbe70f3b19b129eb9` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:44.931756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6095eea9c7174bbdbe70f3b19b129eb9)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:44.934047 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:45.108999 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6095eea9c7174bbdbe70f3b19b129eb9', 'request_id': 'req-ea1d5ae1-123f-4530-9c20-b0f305c4892f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.189821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6095eea9c7174bbdbe70f3b19b129eb9', 'request_id': 'req-ea1d5ae1-123f-4530-9c20-b0f305c4892f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.201267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6095eea9c7174bbdbe70f3b19b129eb9', 'request_id': 'req-ea1d5ae1-123f-4530-9c20-b0f305c4892f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.214543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] The token cache is being invalidate because project 6095eea9c7174bbdbe70f3b19b129eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:45.214981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.219024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:45.221511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ea1d5ae1-123f-4530-9c20-b0f305c4892f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.224407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1145/2279] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:44 2022] DELETE /identity/v3/projects/6095eea9c7174bbdbe70f3b19b129eb9 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:45.231807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10986e-2598-4e56-9d0b-ae588b370fa5 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.231807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10986e-2598-4e56-9d0b-ae588b370fa5 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.231807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10986e-2598-4e56-9d0b-ae588b370fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.271946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-6d10986e-2598-4e56-9d0b-ae588b370fa5 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:45.274948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6d10986e-2598-4e56-9d0b-ae588b370fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:45.286649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:45.451976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1135/2280] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:45.453621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb656e-1c70-4a15-8933-7b6ae4218afb None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.454079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb656e-1c70-4a15-8933-7b6ae4218afb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.454579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb656e-1c70-4a15-8933-7b6ae4218afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.483185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4dbb656e-1c70-4a15-8933-7b6ae4218afb None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:45.487273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4dbb656e-1c70-4a15-8933-7b6ae4218afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:45.512643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1146/2281] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:45.517107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10986e-2598-4e56-9d0b-ae588b370fa5 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:45.529000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10986e-2598-4e56-9d0b-ae588b370fa5 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:45.548593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:45.551328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.552582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.553191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.554341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:45.555065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:45.557593 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:45.578660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1136/2282] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:45.587148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb656e-1c70-4a15-8933-7b6ae4218afb None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:45.618377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb656e-1c70-4a15-8933-7b6ae4218afb None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:45.637073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88564ab3-e5f8-48f8-8f36-c8b02b2fa1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:45.637073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564ab3-e5f8-48f8-8f36-c8b02b2fa1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.637073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564ab3-e5f8-48f8-8f36-c8b02b2fa1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.637073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564ab3-e5f8-48f8-8f36-c8b02b2fa1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.637530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88564ab3-e5f8-48f8-8f36-c8b02b2fa1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:45.651236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88564ab3-e5f8-48f8-8f36-c8b02b2fa1e0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:45.797842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1147/2283] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:45 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:45.805522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:45.836034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d423b-37ee-4f4c-b5bb-804e7a96d24b admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:45.949854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafa879-25da-4f13-a415-44593d627310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:45.950582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafa879-25da-4f13-a415-44593d627310 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.950940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafa879-25da-4f13-a415-44593d627310 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.951223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafa879-25da-4f13-a415-44593d627310 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.951994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafa879-25da-4f13-a415-44593d627310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:45.955406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafa879-25da-4f13-a415-44593d627310 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.063029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1137/2284] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:45 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:56:46.067042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88564ab3-e5f8-48f8-8f36-c8b02b2fa1e0 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.082365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88564ab3-e5f8-48f8-8f36-c8b02b2fa1e0 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.088555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46965f8b-4198-4ad6-9c5f-8f409db29698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.089607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46965f8b-4198-4ad6-9c5f-8f409db29698 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.090337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46965f8b-4198-4ad6-9c5f-8f409db29698 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.091061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46965f8b-4198-4ad6-9c5f-8f409db29698 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.092115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46965f8b-4198-4ad6-9c5f-8f409db29698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.094053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46965f8b-4198-4ad6-9c5f-8f409db29698 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.109338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1148/2285] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:46.113166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafa879-25da-4f13-a415-44593d627310 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.130335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafa879-25da-4f13-a415-44593d627310 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.140990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba42048-4c8d-4591-bb48-f156994fdd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.143589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42048-4c8d-4591-bb48-f156994fdd3b admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.144189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42048-4c8d-4591-bb48-f156994fdd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.144726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42048-4c8d-4591-bb48-f156994fdd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.145766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba42048-4c8d-4591-bb48-f156994fdd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.149382 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba42048-4c8d-4591-bb48-f156994fdd3b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.164813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1138/2286] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:46.176674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46965f8b-4198-4ad6-9c5f-8f409db29698 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.192728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46965f8b-4198-4ad6-9c5f-8f409db29698 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.209898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dfc91-bd24-43b8-b473-e1ab49cc34cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.212659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dfc91-bd24-43b8-b473-e1ab49cc34cc admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.213219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dfc91-bd24-43b8-b473-e1ab49cc34cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.214075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dfc91-bd24-43b8-b473-e1ab49cc34cc admin admin] PATH_INFO: `/v3/projects/9f0a3ed73d0e4a949272a14856938a29/users/dc8d6eb827504313b1d408fd89501312/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.242981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dfc91-bd24-43b8-b473-e1ab49cc34cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0a3ed73d0e4a949272a14856938a29, user_id=dc8d6eb827504313b1d408fd89501312, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.249996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dfc91-bd24-43b8-b473-e1ab49cc34cc admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.385835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1149/2287] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:46 2022] PUT /identity/v3/projects/9f0a3ed73d0e4a949272a14856938a29/users/dc8d6eb827504313b1d408fd89501312/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:46.398905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb4ded-c811-44f4-b4ac-f333c43330d2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.399870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb4ded-c811-44f4-b4ac-f333c43330d2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.400358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb4ded-c811-44f4-b4ac-f333c43330d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.431939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-10bb4ded-c811-44f4-b4ac-f333c43330d2 None None] MFA Rules not processed for user `dc8d6eb827504313b1d408fd89501312`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:46.433187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-10bb4ded-c811-44f4-b4ac-f333c43330d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:46.486676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:46.521807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dfc91-bd24-43b8-b473-e1ab49cc34cc admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.527571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1139/2288] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:46.631238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dfc91-bd24-43b8-b473-e1ab49cc34cc admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.639202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1172c-b79e-405f-ae03-66ff7c29eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.639970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1172c-b79e-405f-ae03-66ff7c29eb63 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.640357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1172c-b79e-405f-ae03-66ff7c29eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.640764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1172c-b79e-405f-ae03-66ff7c29eb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.648278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1172c-b79e-405f-ae03-66ff7c29eb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.650459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1172c-b79e-405f-ae03-66ff7c29eb63 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.777210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb4ded-c811-44f4-b4ac-f333c43330d2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.802712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1150/2289] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:46 2022] POST /identity/v3/projects => generated 383 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:46.806137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb4ded-c811-44f4-b4ac-f333c43330d2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.919766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b3da-6080-413c-b043-35a7abd86e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.921178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b3da-6080-413c-b043-35a7abd86e5c admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.921674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b3da-6080-413c-b043-35a7abd86e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.922191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b3da-6080-413c-b043-35a7abd86e5c admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.923328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1b3da-6080-413c-b043-35a7abd86e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.926665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1b3da-6080-413c-b043-35a7abd86e5c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.943988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:47.125444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1140/2290] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:46 2022] POST /identity/v3/users => generated 298 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:47.135845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1172c-b79e-405f-ae03-66ff7c29eb63 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:47.170357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1172c-b79e-405f-ae03-66ff7c29eb63 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:47.185912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d2861-d33a-433f-ad51-9c4e989ffc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:47.186811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2861-d33a-433f-ad51-9c4e989ffc1c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:47.187240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2861-d33a-433f-ad51-9c4e989ffc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:47.187625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2861-d33a-433f-ad51-9c4e989ffc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:47.188902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d2861-d33a-433f-ad51-9c4e989ffc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:47.192336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d2861-d33a-433f-ad51-9c4e989ffc1c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:47.216036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1151/2291] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:47.216217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b3da-6080-413c-b043-35a7abd86e5c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:47.231023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b3da-6080-413c-b043-35a7abd86e5c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:47.244363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f89b84-f00e-4989-8962-1bcd931b0786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:47.248361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f89b84-f00e-4989-8962-1bcd931b0786 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:47.248361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f89b84-f00e-4989-8962-1bcd931b0786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:47.248361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f89b84-f00e-4989-8962-1bcd931b0786 admin admin] PATH_INFO: `/v3/projects/ab21531b5ea64fed9481f9e1f8996365/users/b4fdca04ece0455097b349b486b942d5/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:47.284000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f89b84-f00e-4989-8962-1bcd931b0786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab21531b5ea64fed9481f9e1f8996365, user_id=b4fdca04ece0455097b349b486b942d5, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:47.286767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f89b84-f00e-4989-8962-1bcd931b0786 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:47.435933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1141/2292] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:47 2022] PUT /identity/v3/projects/ab21531b5ea64fed9481f9e1f8996365/users/b4fdca04ece0455097b349b486b942d5/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:47.440331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d2861-d33a-433f-ad51-9c4e989ffc1c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:47.458326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d2861-d33a-433f-ad51-9c4e989ffc1c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:47.556338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561854ab-e3af-4055-8fc3-42648339b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:47.557078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561854ab-e3af-4055-8fc3-42648339b5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:47.557400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561854ab-e3af-4055-8fc3-42648339b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:47.558374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561854ab-e3af-4055-8fc3-42648339b5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:47.558640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561854ab-e3af-4055-8fc3-42648339b5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:47.560480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561854ab-e3af-4055-8fc3-42648339b5e0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:47.574150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1152/2293] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:47.576799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f89b84-f00e-4989-8962-1bcd931b0786 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:47.593712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f89b84-f00e-4989-8962-1bcd931b0786 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:47.612161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:47.613355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:47.617122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:47.617122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] PATH_INFO: `/v3/projects/ab21531b5ea64fed9481f9e1f8996365/users/b4fdca04ece0455097b349b486b942d5/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:47.621057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab21531b5ea64fed9481f9e1f8996365, user_id=b4fdca04ece0455097b349b486b942d5, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:47.630625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:47.668285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1142/2294] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:47 2022] PUT /identity/v3/projects/ab21531b5ea64fed9481f9e1f8996365/users/b4fdca04ece0455097b349b486b942d5/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:47.670862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6620d-3c5e-4ea1-9083-c2c5d3f7944d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:47.671157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6620d-3c5e-4ea1-9083-c2c5d3f7944d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:47.671439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6620d-3c5e-4ea1-9083-c2c5d3f7944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:47.743694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d9b6620d-3c5e-4ea1-9083-c2c5d3f7944d None None] MFA Rules not processed for user `b4fdca04ece0455097b349b486b942d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:47.743694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d9b6620d-3c5e-4ea1-9083-c2c5d3f7944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:47.894628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1153/2295] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:47.910430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:47.912326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:48.006529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46196d6c-73d9-4d2b-bfd2-7768f3bf07b7 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:48.012100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f945-7daf-4d61-ac1d-175d648fc0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:48.013151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f945-7daf-4d61-ac1d-175d648fc0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:48.013678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f945-7daf-4d61-ac1d-175d648fc0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:48.014207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f945-7daf-4d61-ac1d-175d648fc0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:48.029159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812f945-7daf-4d61-ac1d-175d648fc0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:48.031258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812f945-7daf-4d61-ac1d-175d648fc0f9 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:48.046095 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1143/2296] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:48.230094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:48.361870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:50.161920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:53.492546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6620d-3c5e-4ea1-9083-c2c5d3f7944d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:53.494868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d9b6620d-3c5e-4ea1-9083-c2c5d3f7944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:53.589642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6620d-3c5e-4ea1-9083-c2c5d3f7944d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:53.594599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:53.595536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:53.595913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:53.596215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] PATH_INFO: `/v3/users/6e09b1e3c3e2413685b0d6d601d06eb9` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:53.597485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e09b1e3c3e2413685b0d6d601d06eb9)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:53.599768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:53.786762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e09b1e3c3e2413685b0d6d601d06eb9'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.885465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e09b1e3c3e2413685b0d6d601d06eb9'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.892092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:53.899785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e09b1e3c3e2413685b0d6d601d06eb9'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.907399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e09b1e3c3e2413685b0d6d601d06eb9'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.908696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e09b1e3c3e2413685b0d6d601d06eb9'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.918589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1154/2297] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:53 2022] DELETE /identity/v3/users/6e09b1e3c3e2413685b0d6d601d06eb9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:53.920485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f69f2-5ffe-4d8a-b7b3-d25db589f95a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:53.920984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f69f2-5ffe-4d8a-b7b3-d25db589f95a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:53.921221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f69f2-5ffe-4d8a-b7b3-d25db589f95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:53.952212 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-192f69f2-5ffe-4d8a-b7b3-d25db589f95a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:53.953980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-192f69f2-5ffe-4d8a-b7b3-d25db589f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:54.045496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1144/2298] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:54.136124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.137848 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:54.277207 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316814f9-04bc-4e59-8631-0136c55761b4 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.284182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.284982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.285278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.285619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.299057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.300629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.314833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1155/2299] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:55.083155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f69f2-5ffe-4d8a-b7b3-d25db589f95a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.085076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-192f69f2-5ffe-4d8a-b7b3-d25db589f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.099340 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f69f2-5ffe-4d8a-b7b3-d25db589f95a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.109380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.109380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.109380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.109380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] PATH_INFO: `/v3/projects/49ad271cd2574e48970ccd4b0faa2ec2` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.109793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ad271cd2574e48970ccd4b0faa2ec2)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.112427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.118814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.120367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.175517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e550bb5-b6e4-4ac4-ac0a-f75cbf472ffa service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.180880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.183746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.184181 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.184741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] PATH_INFO: `/v3/users/dc8d6eb827504313b1d408fd89501312` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.186676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8d6eb827504313b1d408fd89501312)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.188672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.260089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ad271cd2574e48970ccd4b0faa2ec2', 'request_id': 'req-1c8645bf-028d-41c6-904e-6a520368d93b'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.372497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ad271cd2574e48970ccd4b0faa2ec2', 'request_id': 'req-1c8645bf-028d-41c6-904e-6a520368d93b'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.374155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ad271cd2574e48970ccd4b0faa2ec2', 'request_id': 'req-1c8645bf-028d-41c6-904e-6a520368d93b'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.396494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] The token cache is being invalidate because project 49ad271cd2574e48970ccd4b0faa2ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:55.396841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.398176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-1c8645bf-028d-41c6-904e-6a520368d93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.400604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1145/2300] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:55 2022] DELETE /identity/v3/projects/49ad271cd2574e48970ccd4b0faa2ec2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:55.409192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b605-914b-4ab5-b1ce-38b0f740632f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.411409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b605-914b-4ab5-b1ce-38b0f740632f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.411409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b605-914b-4ab5-b1ce-38b0f740632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.425315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:55.439605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-5d86b605-914b-4ab5-b1ce-38b0f740632f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:55.441323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5d86b605-914b-4ab5-b1ce-38b0f740632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.499282 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8d6eb827504313b1d408fd89501312'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.552422 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1146/2301] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:55.561016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa630-4f63-4a87-9dfd-c6b9578c86f1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.561845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa630-4f63-4a87-9dfd-c6b9578c86f1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.562068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa630-4f63-4a87-9dfd-c6b9578c86f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.594390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8d6eb827504313b1d408fd89501312'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.597277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4e0aa630-4f63-4a87-9dfd-c6b9578c86f1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:55.599234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4e0aa630-4f63-4a87-9dfd-c6b9578c86f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.612201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1147/2302] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:55.613883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8d6eb827504313b1d408fd89501312'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.615054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aa630-4f63-4a87-9dfd-c6b9578c86f1 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.635723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aa630-4f63-4a87-9dfd-c6b9578c86f1 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.635948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8d6eb827504313b1d408fd89501312'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.636159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-59401414-c4a4-4ae8-8f70-83e19bc483d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8d6eb827504313b1d408fd89501312'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.636904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.638953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.639254 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.639538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.640337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:55.640657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.642449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.646138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1156/2303] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:55 2022] DELETE /identity/v3/users/dc8d6eb827504313b1d408fd89501312 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:55.654277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f4fbd-6730-4474-986e-c93b7bec97e8 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.654809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f4fbd-6730-4474-986e-c93b7bec97e8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.655308 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f4fbd-6730-4474-986e-c93b7bec97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.659453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1148/2304] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:55.666799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.668949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.699357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-317f4fbd-6730-4474-986e-c93b7bec97e8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:55.700753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-317f4fbd-6730-4474-986e-c93b7bec97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.703932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70aef6-7ca8-4ed9-9c4d-69f87b0f021c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.776813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:55.793267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1157/2305] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:55.800825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d1f0-89dd-489d-89c9-e1a3a87e53ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.801776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d1f0-89dd-489d-89c9-e1a3a87e53ce admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.802282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d1f0-89dd-489d-89c9-e1a3a87e53ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.806539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d1f0-89dd-489d-89c9-e1a3a87e53ce admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.816001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61d1f0-89dd-489d-89c9-e1a3a87e53ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.816721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f4fbd-6730-4474-986e-c93b7bec97e8 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.818221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61d1f0-89dd-489d-89c9-e1a3a87e53ce admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.818669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-317f4fbd-6730-4474-986e-c93b7bec97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.908588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f4fbd-6730-4474-986e-c93b7bec97e8 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.913082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fab03-4f5e-43dd-a575-ee43b20f440f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.913837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fab03-4f5e-43dd-a575-ee43b20f440f service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.914145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fab03-4f5e-43dd-a575-ee43b20f440f service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.914424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fab03-4f5e-43dd-a575-ee43b20f440f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.928509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fab03-4f5e-43dd-a575-ee43b20f440f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.930379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fab03-4f5e-43dd-a575-ee43b20f440f service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.934224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1149/2306] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/projects => generated 377 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:55.935215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d1f0-89dd-489d-89c9-e1a3a87e53ce admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.944077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1158/2307] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:56.035177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d1f0-89dd-489d-89c9-e1a3a87e53ce admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:56.042962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6854711-2833-4a12-8ee1-419571c1ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:56.043704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6854711-2833-4a12-8ee1-419571c1ae31 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.044102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6854711-2833-4a12-8ee1-419571c1ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.044381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6854711-2833-4a12-8ee1-419571c1ae31 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.045080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6854711-2833-4a12-8ee1-419571c1ae31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:56.047207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6854711-2833-4a12-8ee1-419571c1ae31 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:56.201685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1150/2308] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:56.206071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fab03-4f5e-43dd-a575-ee43b20f440f service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:56.217665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fab03-4f5e-43dd-a575-ee43b20f440f service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:56.226299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7b42-724b-4222-a096-9d88af9b2b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:56.227846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7b42-724b-4222-a096-9d88af9b2b71 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.228349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7b42-724b-4222-a096-9d88af9b2b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.228849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7b42-724b-4222-a096-9d88af9b2b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.229794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef7b42-724b-4222-a096-9d88af9b2b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:56.232087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef7b42-724b-4222-a096-9d88af9b2b71 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:56.246066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1159/2309] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:56.252426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6854711-2833-4a12-8ee1-419571c1ae31 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:56.265255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6854711-2833-4a12-8ee1-419571c1ae31 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:56.274964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc11ca-44db-46cc-ae8d-7f0390fd624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:56.276189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc11ca-44db-46cc-ae8d-7f0390fd624e admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.280318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc11ca-44db-46cc-ae8d-7f0390fd624e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.280318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc11ca-44db-46cc-ae8d-7f0390fd624e admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.280318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc11ca-44db-46cc-ae8d-7f0390fd624e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:56.281228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc11ca-44db-46cc-ae8d-7f0390fd624e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:56.305221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1151/2310] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:56.309264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7b42-724b-4222-a096-9d88af9b2b71 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:56.325510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7b42-724b-4222-a096-9d88af9b2b71 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:56.331529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6499ef0-c0f9-4126-a44c-ce58561b5970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:56.332896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6499ef0-c0f9-4126-a44c-ce58561b5970 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.334054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6499ef0-c0f9-4126-a44c-ce58561b5970 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.334858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6499ef0-c0f9-4126-a44c-ce58561b5970 admin admin] PATH_INFO: `/v3/projects/757c21ac512e42be9ec4d8b2a2134000/users/f5c252a6f8d54ec9a7338161b25bb016/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.358194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6499ef0-c0f9-4126-a44c-ce58561b5970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=757c21ac512e42be9ec4d8b2a2134000, user_id=f5c252a6f8d54ec9a7338161b25bb016, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:56.361691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6499ef0-c0f9-4126-a44c-ce58561b5970 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:56.459403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1160/2311] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:56 2022] PUT /identity/v3/projects/757c21ac512e42be9ec4d8b2a2134000/users/f5c252a6f8d54ec9a7338161b25bb016/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:56.464622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ed732-2384-459a-91b2-537f78516bc4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.465279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ed732-2384-459a-91b2-537f78516bc4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.465432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ed732-2384-459a-91b2-537f78516bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.491693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4b1ed732-2384-459a-91b2-537f78516bc4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:56.493137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4b1ed732-2384-459a-91b2-537f78516bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:56.578602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1152/2312] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:56.623449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6499ef0-c0f9-4126-a44c-ce58561b5970 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:56.702476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6499ef0-c0f9-4126-a44c-ce58561b5970 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:56.708439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87b4d3-59fc-46ab-b21f-8578401abbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:56.709177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b4d3-59fc-46ab-b21f-8578401abbcf service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.709565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b4d3-59fc-46ab-b21f-8578401abbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.709745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b4d3-59fc-46ab-b21f-8578401abbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.722798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87b4d3-59fc-46ab-b21f-8578401abbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:56.725059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87b4d3-59fc-46ab-b21f-8578401abbcf service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:56.740959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1161/2313] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:57.000317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:57.211071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ed732-2384-459a-91b2-537f78516bc4 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:57.212682 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4b1ed732-2384-459a-91b2-537f78516bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:57.227585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ed732-2384-459a-91b2-537f78516bc4 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:57.232467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:57.233439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:57.233738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:57.234020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] PATH_INFO: `/v3/projects/9f0a3ed73d0e4a949272a14856938a29` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:57.236168 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0a3ed73d0e4a949272a14856938a29)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:57.242262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:57.460469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0a3ed73d0e4a949272a14856938a29', 'request_id': 'req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:57.565789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0a3ed73d0e4a949272a14856938a29', 'request_id': 'req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:57.574873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0a3ed73d0e4a949272a14856938a29', 'request_id': 'req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:57.609664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] The token cache is being invalidate because project 9f0a3ed73d0e4a949272a14856938a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:57.609776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:57.611470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:57.618474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1153/2314] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:57 2022] DELETE /identity/v3/projects/9f0a3ed73d0e4a949272a14856938a29 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:57.619249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87b4d3-59fc-46ab-b21f-8578401abbcf service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:57.634492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87b4d3-59fc-46ab-b21f-8578401abbcf service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:57.786494 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:57.792653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:57.792653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:57.792653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] PATH_INFO: `/v3/users/b4fdca04ece0455097b349b486b942d5` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:57.793385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4fdca04ece0455097b349b486b942d5)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:57.796837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:57.826737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:58.085899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4fdca04ece0455097b349b486b942d5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:58.178216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4fdca04ece0455097b349b486b942d5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:58.195048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4fdca04ece0455097b349b486b942d5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:58.205469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4fdca04ece0455097b349b486b942d5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:58.207134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34c5baf4-5aaf-4ff4-bbde-168e8d67ca61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4fdca04ece0455097b349b486b942d5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:58.215628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1162/2315] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:57 2022] DELETE /identity/v3/users/b4fdca04ece0455097b349b486b942d5 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:59.041068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:59.043840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:59.068479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4dd94-961e-47cd-8ba0-f50ea9fab7e1 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:59.235097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:59.235097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:59.235097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:59.235097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] PATH_INFO: `/v3/projects/ab21531b5ea64fed9481f9e1f8996365` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:59.235466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab21531b5ea64fed9481f9e1f8996365)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:59.240147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:59.282144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:59.508441 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab21531b5ea64fed9481f9e1f8996365', 'request_id': 'req-009be470-6e14-4816-bff3-7a50d122fb51'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:59.600986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab21531b5ea64fed9481f9e1f8996365', 'request_id': 'req-009be470-6e14-4816-bff3-7a50d122fb51'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:59.607921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab21531b5ea64fed9481f9e1f8996365', 'request_id': 'req-009be470-6e14-4816-bff3-7a50d122fb51'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:59.645445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] The token cache is being invalidate because project ab21531b5ea64fed9481f9e1f8996365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:59.647472 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:59.647924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-009be470-6e14-4816-bff3-7a50d122fb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:59.654150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1154/2316] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:59 2022] DELETE /identity/v3/projects/ab21531b5ea64fed9481f9e1f8996365 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:59.660368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9e6a-ef92-4391-a6f9-fce32c2d7261 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:59.661259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9e6a-ef92-4391-a6f9-fce32c2d7261 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:59.662214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9e6a-ef92-4391-a6f9-fce32c2d7261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:59.708222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-bacc9e6a-ef92-4391-a6f9-fce32c2d7261 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:59.710750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bacc9e6a-ef92-4391-a6f9-fce32c2d7261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:59.899682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1163/2317] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:59.910023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373d979-838f-4f02-87bd-403ca11be246 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:59.910327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373d979-838f-4f02-87bd-403ca11be246 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:59.910611 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373d979-838f-4f02-87bd-403ca11be246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:59.949702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0373d979-838f-4f02-87bd-403ca11be246 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:59.951268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0373d979-838f-4f02-87bd-403ca11be246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:59.976531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1155/2318] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:59.981096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b1dc-80ec-4819-96cd-f75c2c5a82cf None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:59.981444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b1dc-80ec-4819-96cd-f75c2c5a82cf None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:59.981728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b1dc-80ec-4819-96cd-f75c2c5a82cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:59.985331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373d979-838f-4f02-87bd-403ca11be246 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:59.997457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373d979-838f-4f02-87bd-403ca11be246 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.015487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.019494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.019494 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.019758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.020588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:00.020901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.032308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.044862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f067b1dc-80ec-4819-96cd-f75c2c5a82cf None None] MFA Rules not processed for user `f5c252a6f8d54ec9a7338161b25bb016`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:00.046426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f067b1dc-80ec-4819-96cd-f75c2c5a82cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:00.059653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1156/2319] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:00.071310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.098696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd49934-6e99-43e5-935a-b08dacb8a1eb admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.112221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5bc7-5b24-4f4a-937c-0622b8e1a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.113297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5bc7-5b24-4f4a-937c-0622b8e1a287 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.113590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5bc7-5b24-4f4a-937c-0622b8e1a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.113872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5bc7-5b24-4f4a-937c-0622b8e1a287 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.114861 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5bc7-5b24-4f4a-937c-0622b8e1a287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.119552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5bc7-5b24-4f4a-937c-0622b8e1a287 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.209669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1164/2320] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:00.212037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b1dc-80ec-4819-96cd-f75c2c5a82cf None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.214881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f067b1dc-80ec-4819-96cd-f75c2c5a82cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:00.235579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b1dc-80ec-4819-96cd-f75c2c5a82cf None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.246359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638218cb-35ca-4715-a2bc-bae6c1e3ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.247569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638218cb-35ca-4715-a2bc-bae6c1e3ffd4 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.248069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638218cb-35ca-4715-a2bc-bae6c1e3ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.248510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638218cb-35ca-4715-a2bc-bae6c1e3ffd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.249417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638218cb-35ca-4715-a2bc-bae6c1e3ffd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.251854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638218cb-35ca-4715-a2bc-bae6c1e3ffd4 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.255120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1157/2321] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:00 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:00.259954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5bc7-5b24-4f4a-937c-0622b8e1a287 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.273410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:00.374827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5bc7-5b24-4f4a-937c-0622b8e1a287 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.392669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd300b1-5752-48ce-afad-212f074143a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.400444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd300b1-5752-48ce-afad-212f074143a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.400924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd300b1-5752-48ce-afad-212f074143a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.402296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd300b1-5752-48ce-afad-212f074143a7 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.404375 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd300b1-5752-48ce-afad-212f074143a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.409679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd300b1-5752-48ce-afad-212f074143a7 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.421215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1165/2322] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:00 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:00.425755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638218cb-35ca-4715-a2bc-bae6c1e3ffd4 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.500883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638218cb-35ca-4715-a2bc-bae6c1e3ffd4 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.506692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b06a25-7837-4b3b-9d63-9067e3ed2c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.507376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06a25-7837-4b3b-9d63-9067e3ed2c7c admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.507665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06a25-7837-4b3b-9d63-9067e3ed2c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.508028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06a25-7837-4b3b-9d63-9067e3ed2c7c admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.508718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b06a25-7837-4b3b-9d63-9067e3ed2c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.510698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b06a25-7837-4b3b-9d63-9067e3ed2c7c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.538971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1158/2323] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:00 2022] POST /identity/v3/users => generated 288 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:00.544790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd300b1-5752-48ce-afad-212f074143a7 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.557850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd300b1-5752-48ce-afad-212f074143a7 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.563380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5b80d-edeb-41d8-882f-2b3c0025fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.564850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5b80d-edeb-41d8-882f-2b3c0025fe2a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.565136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5b80d-edeb-41d8-882f-2b3c0025fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.565416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5b80d-edeb-41d8-882f-2b3c0025fe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.566227 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5b80d-edeb-41d8-882f-2b3c0025fe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.568760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5b80d-edeb-41d8-882f-2b3c0025fe2a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.591726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1166/2324] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:00 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:00.592094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1159/2325] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:00.595904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b06a25-7837-4b3b-9d63-9067e3ed2c7c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.601801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5b80d-edeb-41d8-882f-2b3c0025fe2a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.617097 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b06a25-7837-4b3b-9d63-9067e3ed2c7c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.622382 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5b80d-edeb-41d8-882f-2b3c0025fe2a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.629817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d5f03-40a2-4547-b51a-215d5d56c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.630547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d5f03-40a2-4547-b51a-215d5d56c510 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.630841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d5f03-40a2-4547-b51a-215d5d56c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.631120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d5f03-40a2-4547-b51a-215d5d56c510 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.631857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d5f03-40a2-4547-b51a-215d5d56c510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.634996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d5f03-40a2-4547-b51a-215d5d56c510 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.638628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9e9c-3776-4885-b74f-cd6318df1a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.639324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9e9c-3776-4885-b74f-cd6318df1a00 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.639604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9e9c-3776-4885-b74f-cd6318df1a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.639878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9e9c-3776-4885-b74f-cd6318df1a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.640621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc9e9c-3776-4885-b74f-cd6318df1a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.643320 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc9e9c-3776-4885-b74f-cd6318df1a00 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.660401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1167/2326] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:00.663866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d5f03-40a2-4547-b51a-215d5d56c510 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.675865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1160/2327] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:00.677382 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9e9c-3776-4885-b74f-cd6318df1a00 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.687533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d5f03-40a2-4547-b51a-215d5d56c510 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.703017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9e9c-3776-4885-b74f-cd6318df1a00 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:00.712721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107edc-8318-4ba0-a621-2c085c5266db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.712721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107edc-8318-4ba0-a621-2c085c5266db admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.712721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107edc-8318-4ba0-a621-2c085c5266db admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.712721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107edc-8318-4ba0-a621-2c085c5266db admin admin] PATH_INFO: `/v3/projects/37ae6d70830149fa8fe8f86cb8f80cf8/users/9fe422ef81074dd0890bc1ddbf7ee68a/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.730006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0b915-1668-496f-af9b-f197e92fae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:00.730981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b915-1668-496f-af9b-f197e92fae30 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.731266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b915-1668-496f-af9b-f197e92fae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.731545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b915-1668-496f-af9b-f197e92fae30 admin admin] PATH_INFO: `/v3/projects/1b86bc3df55441b4903c4d63e483272c/users/c571bcdaeec84947afd189520ed1cc82/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.755778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107edc-8318-4ba0-a621-2c085c5266db admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ae6d70830149fa8fe8f86cb8f80cf8, user_id=9fe422ef81074dd0890bc1ddbf7ee68a, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.760509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107edc-8318-4ba0-a621-2c085c5266db admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.771184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b915-1668-496f-af9b-f197e92fae30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b86bc3df55441b4903c4d63e483272c, user_id=c571bcdaeec84947afd189520ed1cc82, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.774501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b915-1668-496f-af9b-f197e92fae30 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.881520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1168/2328] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:00 2022] PUT /identity/v3/projects/37ae6d70830149fa8fe8f86cb8f80cf8/users/9fe422ef81074dd0890bc1ddbf7ee68a/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:00.889211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1161/2329] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:00 2022] PUT /identity/v3/projects/1b86bc3df55441b4903c4d63e483272c/users/c571bcdaeec84947afd189520ed1cc82/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:00.889393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107edc-8318-4ba0-a621-2c085c5266db admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.905322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e70e-e27c-42f1-a28e-7375a0287650 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.905849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e70e-e27c-42f1-a28e-7375a0287650 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.906672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e70e-e27c-42f1-a28e-7375a0287650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.921683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:00.968846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-eb43e70e-e27c-42f1-a28e-7375a0287650 None None] MFA Rules not processed for user `c571bcdaeec84947afd189520ed1cc82`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:00.973073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-eb43e70e-e27c-42f1-a28e-7375a0287650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:01.049466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107edc-8318-4ba0-a621-2c085c5266db admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:01.068053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:01.068867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:01.069224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:01.069643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:01.070531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:01.072243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:01.088335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1162/2330] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:01.099172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1169/2331] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:01.100659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e70e-e27c-42f1-a28e-7375a0287650 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:01.108011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:01.110281 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:01.124181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e70e-e27c-42f1-a28e-7375a0287650 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:01.136413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944c5b-f2e2-420b-b62d-a4be7c555bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:01.149875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944c5b-f2e2-420b-b62d-a4be7c555bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:01.151208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944c5b-f2e2-420b-b62d-a4be7c555bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:01.151604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944c5b-f2e2-420b-b62d-a4be7c555bd6 admin admin] PATH_INFO: `/v3/projects/37ae6d70830149fa8fe8f86cb8f80cf8/users/9fe422ef81074dd0890bc1ddbf7ee68a/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:01.158544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944c5b-f2e2-420b-b62d-a4be7c555bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ae6d70830149fa8fe8f86cb8f80cf8, user_id=9fe422ef81074dd0890bc1ddbf7ee68a, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:01.166732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944c5b-f2e2-420b-b62d-a4be7c555bd6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:01.191854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1163/2332] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:01 2022] PUT /identity/v3/projects/37ae6d70830149fa8fe8f86cb8f80cf8/users/9fe422ef81074dd0890bc1ddbf7ee68a/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:01.219416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:01.238509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2016f4-74d1-4503-a46d-b43be9e95fa8 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:01.328871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56295f0-3a11-4622-b208-31d9390fe8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:01.330366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56295f0-3a11-4622-b208-31d9390fe8ce service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:01.330821 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56295f0-3a11-4622-b208-31d9390fe8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:01.331283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56295f0-3a11-4622-b208-31d9390fe8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:01.403143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56295f0-3a11-4622-b208-31d9390fe8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:01.404651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56295f0-3a11-4622-b208-31d9390fe8ce service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:01.414849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1170/2333] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:03.233692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944c5b-f2e2-420b-b62d-a4be7c555bd6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:03.312931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944c5b-f2e2-420b-b62d-a4be7c555bd6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:03.319650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:03.323859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:03.323859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:03.323859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] PATH_INFO: `/v3/users/c571bcdaeec84947afd189520ed1cc82` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:03.323859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c571bcdaeec84947afd189520ed1cc82)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:03.325397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:03.554941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c571bcdaeec84947afd189520ed1cc82'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.612559 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c571bcdaeec84947afd189520ed1cc82'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.629675 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c571bcdaeec84947afd189520ed1cc82'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.630584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c571bcdaeec84947afd189520ed1cc82'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.641403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c571bcdaeec84947afd189520ed1cc82'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.646490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:03.661262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc019c-75d5-4112-a146-8213f57a69ec None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:03.661807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc019c-75d5-4112-a146-8213f57a69ec None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:03.662202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc019c-75d5-4112-a146-8213f57a69ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:03.664499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1164/2334] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:03 2022] DELETE /identity/v3/users/c571bcdaeec84947afd189520ed1cc82 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:03.683924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-7ffc019c-75d5-4112-a146-8213f57a69ec None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:03.685159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7ffc019c-75d5-4112-a146-8213f57a69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:03.778734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1171/2335] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:03.795944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:03.805210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:03.911881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea220149-41ab-478c-9e0b-cc4fbc603b42 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:03.919798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c21814-0f3a-4688-b60e-c2551a48e809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:03.920163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c21814-0f3a-4688-b60e-c2551a48e809 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:03.920554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c21814-0f3a-4688-b60e-c2551a48e809 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:03.920965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c21814-0f3a-4688-b60e-c2551a48e809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:03.960164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251141d-c2a3-43ed-9ae5-1acc320e9d56 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:03.961360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251141d-c2a3-43ed-9ae5-1acc320e9d56 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:03.961686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251141d-c2a3-43ed-9ae5-1acc320e9d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:03.975275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c21814-0f3a-4688-b60e-c2551a48e809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:03.979070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c21814-0f3a-4688-b60e-c2551a48e809 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:04.005126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1165/2336] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:04.017917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-3251141d-c2a3-43ed-9ae5-1acc320e9d56 None None] MFA Rules not processed for user `9fe422ef81074dd0890bc1ddbf7ee68a`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:04.019507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3251141d-c2a3-43ed-9ae5-1acc320e9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:04.117011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:04.167691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1172/2337] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:04.177790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997326f3-b29e-46ad-adfc-6988bdc2f87f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:04.178230 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997326f3-b29e-46ad-adfc-6988bdc2f87f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:04.178569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997326f3-b29e-46ad-adfc-6988bdc2f87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:04.270365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-997326f3-b29e-46ad-adfc-6988bdc2f87f None None] MFA Rules not processed for user `f5c252a6f8d54ec9a7338161b25bb016`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:04.271721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-997326f3-b29e-46ad-adfc-6988bdc2f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:04.356426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1166/2338] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:04.372870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251141d-c2a3-43ed-9ae5-1acc320e9d56 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:04.373208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3251141d-c2a3-43ed-9ae5-1acc320e9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:04.470527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251141d-c2a3-43ed-9ae5-1acc320e9d56 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:04.477688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d7d4c-b570-464f-8273-95640d309e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:04.478742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d7d4c-b570-464f-8273-95640d309e87 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:04.479084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d7d4c-b570-464f-8273-95640d309e87 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:04.479477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d7d4c-b570-464f-8273-95640d309e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:04.481574 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-225d7d4c-b570-464f-8273-95640d309e87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:04.494748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d7d4c-b570-464f-8273-95640d309e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:04.496897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d7d4c-b570-464f-8273-95640d309e87 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:04.507373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1173/2339] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:05.966530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997326f3-b29e-46ad-adfc-6988bdc2f87f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:05.971470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-997326f3-b29e-46ad-adfc-6988bdc2f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:06.043617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997326f3-b29e-46ad-adfc-6988bdc2f87f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:06.054572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:06.060301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:06.061066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:06.062354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] PATH_INFO: `/v3/projects/1b86bc3df55441b4903c4d63e483272c` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:06.063133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b86bc3df55441b4903c4d63e483272c)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:06.067180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:06.223921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b86bc3df55441b4903c4d63e483272c', 'request_id': 'req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:06.314001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b86bc3df55441b4903c4d63e483272c', 'request_id': 'req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:06.332105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b86bc3df55441b4903c4d63e483272c', 'request_id': 'req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:06.370849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] The token cache is being invalidate because project 1b86bc3df55441b4903c4d63e483272c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:06.371147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:06.373889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-bea7bc97-4e1e-457d-9272-7a1800d6b3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:06.377388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1167/2340] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:05 2022] DELETE /identity/v3/projects/1b86bc3df55441b4903c4d63e483272c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:06.384483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac99cc2-f9dd-4815-aeea-9796c63778a9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:06.385627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac99cc2-f9dd-4815-aeea-9796c63778a9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:06.386299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac99cc2-f9dd-4815-aeea-9796c63778a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:06.409112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-dac99cc2-f9dd-4815-aeea-9796c63778a9 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:06.410590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-dac99cc2-f9dd-4815-aeea-9796c63778a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:06.509620 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1174/2341] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:06.513938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d199d-0d0c-4c4e-8023-c7ffeab8d6ca None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:06.514876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d199d-0d0c-4c4e-8023-c7ffeab8d6ca None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:06.515385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d199d-0d0c-4c4e-8023-c7ffeab8d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:06.546595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1b8d199d-0d0c-4c4e-8023-c7ffeab8d6ca None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:06.548050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1b8d199d-0d0c-4c4e-8023-c7ffeab8d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:06.563312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac99cc2-f9dd-4815-aeea-9796c63778a9 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:06.577460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac99cc2-f9dd-4815-aeea-9796c63778a9 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:06.582485 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1168/2342] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:06.591211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:06.592405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:06.592405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:06.592599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:06.593243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:06.593538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:06.598659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:06.613397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1175/2343] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:57:06.617985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d199d-0d0c-4c4e-8023-c7ffeab8d6ca None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:06.633144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d199d-0d0c-4c4e-8023-c7ffeab8d6ca None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:06.644349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad13b5f-f2aa-46e7-84b8-350a83590555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:06.645131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad13b5f-f2aa-46e7-84b8-350a83590555 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:06.645459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad13b5f-f2aa-46e7-84b8-350a83590555 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:06.645621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad13b5f-f2aa-46e7-84b8-350a83590555 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:06.649736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad13b5f-f2aa-46e7-84b8-350a83590555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:06.672264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad13b5f-f2aa-46e7-84b8-350a83590555 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:06.771620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1169/2344] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:06 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:06.774682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:06.792211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4766c2-162d-4850-b7b3-7bb882b0e21d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:06.864517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:06.879951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160fb68-fd15-4d91-8420-9e0ead204c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:06.880730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fb68-fd15-4d91-8420-9e0ead204c09 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:06.881093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fb68-fd15-4d91-8420-9e0ead204c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:06.881449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fb68-fd15-4d91-8420-9e0ead204c09 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:06.882358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160fb68-fd15-4d91-8420-9e0ead204c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:06.884479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160fb68-fd15-4d91-8420-9e0ead204c09 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:06.992098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1176/2345] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:06 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:06.996061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad13b5f-f2aa-46e7-84b8-350a83590555 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:07.004558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:07.011504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad13b5f-f2aa-46e7-84b8-350a83590555 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:07.019323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ba991-f3c0-40d4-805d-156f9e0ea4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:07.020281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ba991-f3c0-40d4-805d-156f9e0ea4cd admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:07.021243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ba991-f3c0-40d4-805d-156f9e0ea4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:07.021705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ba991-f3c0-40d4-805d-156f9e0ea4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:07.023704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ba991-f3c0-40d4-805d-156f9e0ea4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:07.026399 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ba991-f3c0-40d4-805d-156f9e0ea4cd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:07.055902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160fb68-fd15-4d91-8420-9e0ead204c09 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:07.062895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1170/2346] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:07.068566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160fb68-fd15-4d91-8420-9e0ead204c09 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:07.083490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6be04-d4bb-4577-af2f-c93e8d96bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:07.084488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6be04-d4bb-4577-af2f-c93e8d96bbec admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:07.084986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6be04-d4bb-4577-af2f-c93e8d96bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:07.085517 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6be04-d4bb-4577-af2f-c93e8d96bbec admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:07.087588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6be04-d4bb-4577-af2f-c93e8d96bbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:07.089961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6be04-d4bb-4577-af2f-c93e8d96bbec admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:07.107636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1177/2347] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:07.112466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ba991-f3c0-40d4-805d-156f9e0ea4cd admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:07.135510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ba991-f3c0-40d4-805d-156f9e0ea4cd admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:07.141713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:07.148894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:07.148894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:07.148894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] PATH_INFO: `/v3/projects/104e3111370c41c9b2e6099f31c2d14c/users/1cf67b93b90f43799ad0d20220793e89/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:07.178872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104e3111370c41c9b2e6099f31c2d14c, user_id=1cf67b93b90f43799ad0d20220793e89, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:07.182322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:07.283594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1171/2348] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:07 2022] PUT /identity/v3/projects/104e3111370c41c9b2e6099f31c2d14c/users/1cf67b93b90f43799ad0d20220793e89/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:07.295081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad20f5-7cc1-4739-87da-03225ab25be2 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:07.296126 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad20f5-7cc1-4739-87da-03225ab25be2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:07.296754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad20f5-7cc1-4739-87da-03225ab25be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:07.380930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-17ad20f5-7cc1-4739-87da-03225ab25be2 None None] MFA Rules not processed for user `1cf67b93b90f43799ad0d20220793e89`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:07.389148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-17ad20f5-7cc1-4739-87da-03225ab25be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:07.586876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1178/2349] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:07.659998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:07.662210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:07.838426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53b4a2-8339-4d89-9698-5312a1bcd235 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:07.838426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:07.838426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:07.838426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:07.838758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:07.838758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:07.838758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:07.839855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1172/2350] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:07.857613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad20f5-7cc1-4739-87da-03225ab25be2 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:07.969447 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad20f5-7cc1-4739-87da-03225ab25be2 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:07.978149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:07.979612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:07.980154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:07.980611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] PATH_INFO: `/v3/users/1cf67b93b90f43799ad0d20220793e89` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:07.982336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf67b93b90f43799ad0d20220793e89)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:07.984947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:08.266193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:08.266193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:08.386967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32ed93-cf69-40df-9148-daafffa582f0 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:08.386967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:08.387778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:08.389130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:08.389642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:08.393560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:08.411981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:08.414430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:08.433985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1173/2351] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:08.565060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf67b93b90f43799ad0d20220793e89'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:08.675428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf67b93b90f43799ad0d20220793e89'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:08.694277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:08.723971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf67b93b90f43799ad0d20220793e89'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:08.738711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:08.740438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:08.763445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dad39-4b2d-4e84-a3bc-926cd2f4a23e service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:08.767990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf67b93b90f43799ad0d20220793e89'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:08.770967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-adec436b-fb78-4694-b550-43492f7c9bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf67b93b90f43799ad0d20220793e89'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:08.776876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:08.776876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:08.778598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:08.779055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] PATH_INFO: `/v3/users/13011e0bc7784d6b92e8683009d13436` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:08.782462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1179/2352] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:07 2022] DELETE /identity/v3/users/1cf67b93b90f43799ad0d20220793e89 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:08.783053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13011e0bc7784d6b92e8683009d13436)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:08.786621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a011c-b150-4507-ae98-f5a556e8f57d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:08.787767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a011c-b150-4507-ae98-f5a556e8f57d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:08.788866 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:08.790369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a011c-b150-4507-ae98-f5a556e8f57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:08.900556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-952a011c-b150-4507-ae98-f5a556e8f57d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:08.909462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-952a011c-b150-4507-ae98-f5a556e8f57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:09.055970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1180/2353] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:09.085677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a011c-b150-4507-ae98-f5a556e8f57d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:09.092785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-952a011c-b150-4507-ae98-f5a556e8f57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:09.158668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13011e0bc7784d6b92e8683009d13436'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:09.271912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a011c-b150-4507-ae98-f5a556e8f57d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:09.278650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6d221-9eb4-4e2a-9653-b2a1c398ef50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:09.279784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d221-9eb4-4e2a-9653-b2a1c398ef50 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:09.279980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d221-9eb4-4e2a-9653-b2a1c398ef50 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:09.280258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d221-9eb4-4e2a-9653-b2a1c398ef50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:09.292027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13011e0bc7784d6b92e8683009d13436'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:09.294815 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:09.309564 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6d221-9eb4-4e2a-9653-b2a1c398ef50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:09.315094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6d221-9eb4-4e2a-9653-b2a1c398ef50 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:09.315963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13011e0bc7784d6b92e8683009d13436'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:09.319049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13011e0bc7784d6b92e8683009d13436'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:09.338292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13011e0bc7784d6b92e8683009d13436'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:09.346501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1181/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:09.352017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1174/2355] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:08 2022] DELETE /identity/v3/users/13011e0bc7784d6b92e8683009d13436 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:09.356765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc534d-0d5f-4197-af44-9665dde3c39c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:09.357310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc534d-0d5f-4197-af44-9665dde3c39c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:09.358062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc534d-0d5f-4197-af44-9665dde3c39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:09.401542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1ffc534d-0d5f-4197-af44-9665dde3c39c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:09.403068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1ffc534d-0d5f-4197-af44-9665dde3c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:09.578183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1182/2356] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:09.605085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:09.609941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:09.731857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c1d3-99b8-4792-b578-ef0f4c9bd974 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:09.738613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:09.740974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:09.740974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:09.740974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:09.752837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:09.754683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:09.771319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1175/2357] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:10.836048 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc534d-0d5f-4197-af44-9665dde3c39c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:10.838304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1ffc534d-0d5f-4197-af44-9665dde3c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:10.855407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc534d-0d5f-4197-af44-9665dde3c39c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:10.866698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:10.868773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:10.869568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:10.870448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] PATH_INFO: `/v3/projects/5c33bb9acaeb4e4dbc8207aa15bf6676` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:10.875108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c33bb9acaeb4e4dbc8207aa15bf6676)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:10.879283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:10.903433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:10.908123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:10.937256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c3f88-05fb-4d09-9998-385db9c00f61 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:10.948317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:10.950232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:10.950884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:10.951444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] PATH_INFO: `/v3/projects/104e3111370c41c9b2e6099f31c2d14c` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:10.955035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:10.961989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104e3111370c41c9b2e6099f31c2d14c)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:10.965680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.059442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c33bb9acaeb4e4dbc8207aa15bf6676', 'request_id': 'req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.128683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104e3111370c41c9b2e6099f31c2d14c', 'request_id': 'req-18b7aaf7-2512-4365-a2f0-93a2efb4b302'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.130696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c33bb9acaeb4e4dbc8207aa15bf6676', 'request_id': 'req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.138807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c33bb9acaeb4e4dbc8207aa15bf6676', 'request_id': 'req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.153839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] The token cache is being invalidate because project 5c33bb9acaeb4e4dbc8207aa15bf6676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:11.154179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.154856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b4f43025-0cc6-43bc-b062-3a0f8d9d6dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.156479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1183/2358] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:10 2022] DELETE /identity/v3/projects/5c33bb9acaeb4e4dbc8207aa15bf6676 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:11.162665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbce28-1f1f-4a6b-aa25-0a3911c3e4cd None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.163257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbce28-1f1f-4a6b-aa25-0a3911c3e4cd None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.169711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbce28-1f1f-4a6b-aa25-0a3911c3e4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.185392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-74dbce28-1f1f-4a6b-aa25-0a3911c3e4cd None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:11.187633 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-74dbce28-1f1f-4a6b-aa25-0a3911c3e4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:11.230089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104e3111370c41c9b2e6099f31c2d14c', 'request_id': 'req-18b7aaf7-2512-4365-a2f0-93a2efb4b302'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.248160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104e3111370c41c9b2e6099f31c2d14c', 'request_id': 'req-18b7aaf7-2512-4365-a2f0-93a2efb4b302'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.263154 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] The token cache is being invalidate because project 104e3111370c41c9b2e6099f31c2d14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:11.263446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.264286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-18b7aaf7-2512-4365-a2f0-93a2efb4b302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:11.265906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1176/2359] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:10 2022] DELETE /identity/v3/projects/104e3111370c41c9b2e6099f31c2d14c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:11.271523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620bd1a-1e6d-4c60-abbd-bc0ca4b2c79e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.272015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620bd1a-1e6d-4c60-abbd-bc0ca4b2c79e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.272441 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620bd1a-1e6d-4c60-abbd-bc0ca4b2c79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.275359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1184/2360] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:11.283915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d87d1-f213-468a-a499-c99f04936e60 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.291135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d87d1-f213-468a-a499-c99f04936e60 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.291135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d87d1-f213-468a-a499-c99f04936e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.303716 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-088d87d1-f213-468a-a499-c99f04936e60 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:11.304951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-088d87d1-f213-468a-a499-c99f04936e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:11.306500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0620bd1a-1e6d-4c60-abbd-bc0ca4b2c79e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:11.311794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0620bd1a-1e6d-4c60-abbd-bc0ca4b2c79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:11.319605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1185/2361] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:11.320581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d87d1-f213-468a-a499-c99f04936e60 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.325875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1177/2362] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:11.332149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d87d1-f213-468a-a499-c99f04936e60 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.335792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8a50-b0dd-42cb-bf0f-1586e8848637 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.336319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8a50-b0dd-42cb-bf0f-1586e8848637 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.337156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8a50-b0dd-42cb-bf0f-1586e8848637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.337956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.338673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.339008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.339287 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.340027 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:11.340345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.342600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.358459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1186/2363] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:11.364470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.381103 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18524040-4b3b-4b88-b1d6-c42a6cc9b336 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.388327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3f9a8a50-b0dd-42cb-bf0f-1586e8848637 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:11.390388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3f9a8a50-b0dd-42cb-bf0f-1586e8848637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:11.401976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6ae5a-c1f3-4b1e-a2e7-15629eda0244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.403459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6ae5a-c1f3-4b1e-a2e7-15629eda0244 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.403690 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6ae5a-c1f3-4b1e-a2e7-15629eda0244 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.404593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6ae5a-c1f3-4b1e-a2e7-15629eda0244 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.406865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6ae5a-c1f3-4b1e-a2e7-15629eda0244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.411909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6ae5a-c1f3-4b1e-a2e7-15629eda0244 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.413298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1178/2364] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:11.419585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a8a50-b0dd-42cb-bf0f-1586e8848637 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.447801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a8a50-b0dd-42cb-bf0f-1586e8848637 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.453804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.454614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.455041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.455473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.457047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:11.457047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.458587 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.475977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1179/2365] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:11.479654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.496039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd068-bd98-47a6-ab35-12a78bc04586 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.504802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf52054-2cf2-451b-9bae-631a4df9d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.506179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf52054-2cf2-451b-9bae-631a4df9d135 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.506680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf52054-2cf2-451b-9bae-631a4df9d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.507144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf52054-2cf2-451b-9bae-631a4df9d135 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.507315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1187/2366] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:11.508337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf52054-2cf2-451b-9bae-631a4df9d135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.510469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf52054-2cf2-451b-9bae-631a4df9d135 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.511265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6ae5a-c1f3-4b1e-a2e7-15629eda0244 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.590932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6ae5a-c1f3-4b1e-a2e7-15629eda0244 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.597114 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a5019-e6c3-462f-b83b-3381eba89ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.597798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a5019-e6c3-462f-b83b-3381eba89ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.598084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a5019-e6c3-462f-b83b-3381eba89ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.598403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a5019-e6c3-462f-b83b-3381eba89ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.599104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a5019-e6c3-462f-b83b-3381eba89ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.601186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a5019-e6c3-462f-b83b-3381eba89ed0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.628390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1180/2367] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:11.636124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf52054-2cf2-451b-9bae-631a4df9d135 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.648408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:11.698904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1188/2368] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:11.703870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a5019-e6c3-462f-b83b-3381eba89ed0 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.715438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a5019-e6c3-462f-b83b-3381eba89ed0 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.725967 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecafb1b-61aa-46cf-9213-06188eaa8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.726906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecafb1b-61aa-46cf-9213-06188eaa8ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.732637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecafb1b-61aa-46cf-9213-06188eaa8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.732793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf52054-2cf2-451b-9bae-631a4df9d135 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.732914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecafb1b-61aa-46cf-9213-06188eaa8ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.732914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecafb1b-61aa-46cf-9213-06188eaa8ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.732914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecafb1b-61aa-46cf-9213-06188eaa8ef0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.738158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.739118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.740281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.740788 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.743143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:11.744645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.749940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.764981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1189/2369] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:11.766000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecafb1b-61aa-46cf-9213-06188eaa8ef0 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.778160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecafb1b-61aa-46cf-9213-06188eaa8ef0 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.784160 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f011-c2f7-4053-b8c2-552ca0c2e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.786021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f011-c2f7-4053-b8c2-552ca0c2e1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.786021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f011-c2f7-4053-b8c2-552ca0c2e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.786021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f011-c2f7-4053-b8c2-552ca0c2e1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.786530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981f011-c2f7-4053-b8c2-552ca0c2e1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.789342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981f011-c2f7-4053-b8c2-552ca0c2e1b4 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.805206 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1190/2370] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:11.806125 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f011-c2f7-4053-b8c2-552ca0c2e1b4 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.824730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f011-c2f7-4053-b8c2-552ca0c2e1b4 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.829604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efddfe-11f2-4b4f-a53a-e0e46efe26fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.830548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efddfe-11f2-4b4f-a53a-e0e46efe26fd admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.830841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efddfe-11f2-4b4f-a53a-e0e46efe26fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.831124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efddfe-11f2-4b4f-a53a-e0e46efe26fd admin admin] PATH_INFO: `/v3/projects/34e0e20ac70746f0925067fc107ad9bf/users/e9a039aa8d2e4f2a9f3de244b051b485/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.847701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efddfe-11f2-4b4f-a53a-e0e46efe26fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e0e20ac70746f0925067fc107ad9bf, user_id=e9a039aa8d2e4f2a9f3de244b051b485, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:11.850415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efddfe-11f2-4b4f-a53a-e0e46efe26fd admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:11.890427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1181/2371] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:11.890427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.890769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:11.967034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1191/2372] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:11 2022] PUT /identity/v3/projects/34e0e20ac70746f0925067fc107ad9bf/users/e9a039aa8d2e4f2a9f3de244b051b485/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:11.968527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efddfe-11f2-4b4f-a53a-e0e46efe26fd admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.979804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde624e2-a28d-42c4-9724-580bd08a32cc admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:12.051566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efddfe-11f2-4b4f-a53a-e0e46efe26fd admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:12.055730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:12.056474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.056844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.057187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.060133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:12.066926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4d6d7-1848-48bb-8c3b-be982df92b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:12.067321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d6d7-1848-48bb-8c3b-be982df92b61 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.067604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d6d7-1848-48bb-8c3b-be982df92b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.067950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d6d7-1848-48bb-8c3b-be982df92b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.068631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4d6d7-1848-48bb-8c3b-be982df92b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:12.070279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4d6d7-1848-48bb-8c3b-be982df92b61 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:12.086623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1192/2373] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:12.088010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001796-3f7b-4ad4-aa33-1c24ccf6cf51 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.088307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001796-3f7b-4ad4-aa33-1c24ccf6cf51 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.088588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001796-3f7b-4ad4-aa33-1c24ccf6cf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.122291 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-76001796-3f7b-4ad4-aa33-1c24ccf6cf51 None None] MFA Rules not processed for user `e9a039aa8d2e4f2a9f3de244b051b485`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:12.123520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-76001796-3f7b-4ad4-aa33-1c24ccf6cf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:12.174267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:12.176196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:12.192951 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1182/2374] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:12.197159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:12.209498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc84ea-e857-4c73-af5e-7f26df93e485 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:12.218822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:12.220272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.220547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.220931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.221826 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:12.224491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:12.228167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1193/2375] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:12.250292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001796-3f7b-4ad4-aa33-1c24ccf6cf51 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:12.251767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1183/2376] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:12.262383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001796-3f7b-4ad4-aa33-1c24ccf6cf51 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:12.280903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128500d-4571-42cb-98b3-b3c8583a1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:12.282029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128500d-4571-42cb-98b3-b3c8583a1fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.282615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128500d-4571-42cb-98b3-b3c8583a1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.283115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128500d-4571-42cb-98b3-b3c8583a1fc5 admin admin] PATH_INFO: `/v3/projects/2c57f782327040b6a5209a4b38bf3b6c/users/ad2748d7c446463e9e97ec6f92299efa/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.301614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128500d-4571-42cb-98b3-b3c8583a1fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c57f782327040b6a5209a4b38bf3b6c, user_id=ad2748d7c446463e9e97ec6f92299efa, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:12.305437 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128500d-4571-42cb-98b3-b3c8583a1fc5 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:12.336721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:12.339180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:12.361799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41505054-dc00-41d6-8367-ddf1c2f823da admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:12.367515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeff80-1456-47f4-9128-e1e530097701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:12.368829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeff80-1456-47f4-9128-e1e530097701 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.369878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeff80-1456-47f4-9128-e1e530097701 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.369878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeff80-1456-47f4-9128-e1e530097701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.394446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfeff80-1456-47f4-9128-e1e530097701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:12.396754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfeff80-1456-47f4-9128-e1e530097701 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:12.421200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1194/2377] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:12 2022] PUT /identity/v3/projects/2c57f782327040b6a5209a4b38bf3b6c/users/ad2748d7c446463e9e97ec6f92299efa/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:12.426136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e91a1e-34a8-4a68-bb8a-c476f0f56ec8 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.426555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e91a1e-34a8-4a68-bb8a-c476f0f56ec8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.426908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e91a1e-34a8-4a68-bb8a-c476f0f56ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.441373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1184/2378] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:12.475842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-38e91a1e-34a8-4a68-bb8a-c476f0f56ec8 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:12.478478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-38e91a1e-34a8-4a68-bb8a-c476f0f56ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:12.588250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1195/2379] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:12.588994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeff80-1456-47f4-9128-e1e530097701 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:12.612364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeff80-1456-47f4-9128-e1e530097701 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:12.696865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:12.697906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.698231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.698665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.699373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:12.701440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:12.843102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e91a1e-34a8-4a68-bb8a-c476f0f56ec8 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:12.852033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1185/2380] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:12 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:12.855367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:12.857672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:12.859834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e91a1e-34a8-4a68-bb8a-c476f0f56ec8 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:12.936950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:12.949764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd3f7b-9c72-43b2-8cc3-00434f38256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:12.950948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd3f7b-9c72-43b2-8cc3-00434f38256d admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:12.951564 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd3f7b-9c72-43b2-8cc3-00434f38256d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:12.952024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd3f7b-9c72-43b2-8cc3-00434f38256d admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.952903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd3f7b-9c72-43b2-8cc3-00434f38256d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:12.956840 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd3f7b-9c72-43b2-8cc3-00434f38256d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:12.994318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:13.008982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f8f1-69e3-43aa-be23-1382ce257b57 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:13.014731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:13.015923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:13.016207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:13.018267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] PATH_INFO: `/v3/users/5d13a03003314d28bb2919284108ca37` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:13.018945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d13a03003314d28bb2919284108ca37)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:13.021094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:13.068380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1196/2381] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:12 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:13.072706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd3f7b-9c72-43b2-8cc3-00434f38256d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:13.084315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd3f7b-9c72-43b2-8cc3-00434f38256d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:13.098609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092f54a-4551-429e-bfbe-c2470c27959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:13.098609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092f54a-4551-429e-bfbe-c2470c27959c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:13.098609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092f54a-4551-429e-bfbe-c2470c27959c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:13.098609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092f54a-4551-429e-bfbe-c2470c27959c admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:13.099059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092f54a-4551-429e-bfbe-c2470c27959c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:13.100273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092f54a-4551-429e-bfbe-c2470c27959c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:13.127808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1197/2382] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:13.129205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092f54a-4551-429e-bfbe-c2470c27959c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:13.154318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092f54a-4551-429e-bfbe-c2470c27959c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:13.159854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a20a32-f239-4a09-8dc0-97a4cab4a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:13.161131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a20a32-f239-4a09-8dc0-97a4cab4a830 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:13.161423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a20a32-f239-4a09-8dc0-97a4cab4a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:13.161705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a20a32-f239-4a09-8dc0-97a4cab4a830 admin admin] PATH_INFO: `/v3/projects/e9e6786be56b48318aa0a3ed26d9f78a/users/cc894f5686bc411196119194b99261e3/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:13.190496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a20a32-f239-4a09-8dc0-97a4cab4a830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e6786be56b48318aa0a3ed26d9f78a, user_id=cc894f5686bc411196119194b99261e3, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:13.193545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a20a32-f239-4a09-8dc0-97a4cab4a830 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:13.269307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d13a03003314d28bb2919284108ca37'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:13.338416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1198/2383] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:13 2022] PUT /identity/v3/projects/e9e6786be56b48318aa0a3ed26d9f78a/users/cc894f5686bc411196119194b99261e3/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:13.342169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a20a32-f239-4a09-8dc0-97a4cab4a830 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:13.388324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d13a03003314d28bb2919284108ca37'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:13.406797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d13a03003314d28bb2919284108ca37'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:13.407569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d13a03003314d28bb2919284108ca37'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:13.414832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0666db40-0132-46c0-9b1d-82acdb24893d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d13a03003314d28bb2919284108ca37'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:13.415386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a20a32-f239-4a09-8dc0-97a4cab4a830 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:13.420404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:13.421356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:13.421488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1186/2384] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:12 2022] DELETE /identity/v3/users/5d13a03003314d28bb2919284108ca37 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:13.426510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4593-9b70-432d-a18c-09224c0871be None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:13.426808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4593-9b70-432d-a18c-09224c0871be None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:13.427127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4593-9b70-432d-a18c-09224c0871be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:13.433486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:13.434708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:13.434708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:13.437019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:13.463363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c6eb4593-9b70-432d-a18c-09224c0871be None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:13.465846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c6eb4593-9b70-432d-a18c-09224c0871be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:13.467273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1199/2385] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:13.471380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:13.476434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:13.507735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1c96-9e5b-45b0-b092-c53bc6875656 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:13.592975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1187/2386] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:13.648235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb4593-9b70-432d-a18c-09224c0871be None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:13.648488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae86b0-3d36-4443-b1a9-5ba6cfb2a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:13.649184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae86b0-3d36-4443-b1a9-5ba6cfb2a354 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:13.649474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae86b0-3d36-4443-b1a9-5ba6cfb2a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:13.649763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae86b0-3d36-4443-b1a9-5ba6cfb2a354 admin admin] PATH_INFO: `/v3/projects/e9e6786be56b48318aa0a3ed26d9f78a/users/cc894f5686bc411196119194b99261e3/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:13.652161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c6eb4593-9b70-432d-a18c-09224c0871be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:13.663284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae86b0-3d36-4443-b1a9-5ba6cfb2a354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e6786be56b48318aa0a3ed26d9f78a, user_id=cc894f5686bc411196119194b99261e3, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:13.666062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae86b0-3d36-4443-b1a9-5ba6cfb2a354 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:13.705767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1200/2387] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:13 2022] PUT /identity/v3/projects/e9e6786be56b48318aa0a3ed26d9f78a/users/cc894f5686bc411196119194b99261e3/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:13.708736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72f0a-dc8d-4dcf-9b7d-cfcc81d8f82f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:13.709041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72f0a-dc8d-4dcf-9b7d-cfcc81d8f82f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:13.710951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72f0a-dc8d-4dcf-9b7d-cfcc81d8f82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:13.761163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-dee72f0a-dc8d-4dcf-9b7d-cfcc81d8f82f None None] MFA Rules not processed for user `cc894f5686bc411196119194b99261e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:13.783323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb4593-9b70-432d-a18c-09224c0871be None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:13.796627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-dee72f0a-dc8d-4dcf-9b7d-cfcc81d8f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:13.924553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:13.925743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:13.926218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:13.926656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:13.965450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1201/2388] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:14.004981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee72f0a-dc8d-4dcf-9b7d-cfcc81d8f82f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:14.027200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee72f0a-dc8d-4dcf-9b7d-cfcc81d8f82f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:14.043450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce9b59-f816-4f08-a555-900e1dbfdbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:14.045477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9b59-f816-4f08-a555-900e1dbfdbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:14.045775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9b59-f816-4f08-a555-900e1dbfdbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:14.046060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9b59-f816-4f08-a555-900e1dbfdbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:14.056355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:14.059384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:14.084622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-96ce9b59-f816-4f08-a555-900e1dbfdbf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:14.086258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:14.095490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1188/2389] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:14.171479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:14.174143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce9b59-f816-4f08-a555-900e1dbfdbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:14.176013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce9b59-f816-4f08-a555-900e1dbfdbf7 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:14.187510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1202/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:14.614913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:14.616445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:14.632242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdada60-644f-4c34-9e5b-9b9739fb8897 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:14.638703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:14.639414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:14.639754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:14.640598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] PATH_INFO: `/v3/projects/9127b54157534e838fb68568960be749` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:14.641605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9127b54157534e838fb68568960be749)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:14.643971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:14.865971 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9127b54157534e838fb68568960be749', 'request_id': 'req-4cf12c5c-f268-42b4-b431-ca30f60d3af7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:14.954370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9127b54157534e838fb68568960be749', 'request_id': 'req-4cf12c5c-f268-42b4-b431-ca30f60d3af7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:14.961857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9127b54157534e838fb68568960be749', 'request_id': 'req-4cf12c5c-f268-42b4-b431-ca30f60d3af7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:14.978466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] The token cache is being invalidate because project 9127b54157534e838fb68568960be749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:14.978765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:14.979533 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4cf12c5c-f268-42b4-b431-ca30f60d3af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:14.981730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1189/2391] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:14 2022] DELETE /identity/v3/projects/9127b54157534e838fb68568960be749 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:14.987264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269abbb-0da6-4a48-82a0-e69084067238 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:14.996934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269abbb-0da6-4a48-82a0-e69084067238 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:14.996934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269abbb-0da6-4a48-82a0-e69084067238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:15.015025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4269abbb-0da6-4a48-82a0-e69084067238 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:15.016312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4269abbb-0da6-4a48-82a0-e69084067238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:15.124808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1203/2392] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:15.132649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6c0ca-2f33-4b29-9dd9-c89a08cd391c None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:15.133567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6c0ca-2f33-4b29-9dd9-c89a08cd391c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:15.134065 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6c0ca-2f33-4b29-9dd9-c89a08cd391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:15.175149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-34b6c0ca-2f33-4b29-9dd9-c89a08cd391c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:15.176829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-34b6c0ca-2f33-4b29-9dd9-c89a08cd391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:15.190166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1190/2393] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:15.194236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269abbb-0da6-4a48-82a0-e69084067238 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:15.219053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269abbb-0da6-4a48-82a0-e69084067238 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:15.238093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:15.238861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:15.239153 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:15.239438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:15.242016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:15.242386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:15.247057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:15.270609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1204/2394] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:15.275041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6c0ca-2f33-4b29-9dd9-c89a08cd391c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:15.287453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6c0ca-2f33-4b29-9dd9-c89a08cd391c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:15.293210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39439378-8103-4c33-8531-ba0be3d28d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:15.294042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439378-8103-4c33-8531-ba0be3d28d24 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:15.294596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439378-8103-4c33-8531-ba0be3d28d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:15.294958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439378-8103-4c33-8531-ba0be3d28d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:15.296474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39439378-8103-4c33-8531-ba0be3d28d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:15.299205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39439378-8103-4c33-8531-ba0be3d28d24 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:15.389722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:15.390875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:15.483124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1191/2395] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:15 2022] POST /identity/v3/projects => generated 361 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:15.487859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39439378-8103-4c33-8531-ba0be3d28d24 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:15.557171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c13325-e3fc-4f10-ac66-7325a9a4dd4c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:15.568649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:15.644981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39439378-8103-4c33-8531-ba0be3d28d24 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:15.667216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:15.668289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:15.668785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:15.669333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:15.670914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82bb4-24ff-4365-baf8-6f7811abc6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:15.671695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82bb4-24ff-4365-baf8-6f7811abc6ab admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:15.671816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:15.671983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82bb4-24ff-4365-baf8-6f7811abc6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:15.672390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82bb4-24ff-4365-baf8-6f7811abc6ab admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:15.673266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd82bb4-24ff-4365-baf8-6f7811abc6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:15.675440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd82bb4-24ff-4365-baf8-6f7811abc6ab admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:15.811356 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1192/2396] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:15 2022] POST /identity/v3/users => generated 281 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:15.816085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82bb4-24ff-4365-baf8-6f7811abc6ab admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:15.823305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:15.825852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:15.844813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82bb4-24ff-4365-baf8-6f7811abc6ab admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:15.845012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1205/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:15.853590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcd6df-5544-458f-810c-6c54dc25efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:15.854479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcd6df-5544-458f-810c-6c54dc25efd2 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:15.854961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcd6df-5544-458f-810c-6c54dc25efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:15.855384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcd6df-5544-458f-810c-6c54dc25efd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:15.856466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcd6df-5544-458f-810c-6c54dc25efd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:15.869728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcd6df-5544-458f-810c-6c54dc25efd2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:15.914702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1193/2398] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:15.915898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:15.948973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2d524-f56d-4d82-9791-fdd9df0c7a00 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:15.954557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2a323-c16b-4a50-b949-76b270390b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:15.955262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2a323-c16b-4a50-b949-76b270390b1f admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:15.955603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2a323-c16b-4a50-b949-76b270390b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:15.956043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2a323-c16b-4a50-b949-76b270390b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:15.956699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2a323-c16b-4a50-b949-76b270390b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:15.958525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2a323-c16b-4a50-b949-76b270390b1f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:15.970675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1206/2399] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:15.975369 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcd6df-5544-458f-810c-6c54dc25efd2 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:15.996253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcd6df-5544-458f-810c-6c54dc25efd2 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:16.005361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:16.006315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:16.006608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:16.006952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] PATH_INFO: `/v3/projects/b6144015b19b43f680ff1185ad11801d/users/1ff996f5410b4b11aca1034c992e96f5/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:16.038743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6144015b19b43f680ff1185ad11801d, user_id=1ff996f5410b4b11aca1034c992e96f5, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:16.047476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:16.079972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:16.157857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1194/2400] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:15 2022] PUT /identity/v3/projects/b6144015b19b43f680ff1185ad11801d/users/1ff996f5410b4b11aca1034c992e96f5/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:16.167830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369f52-9d3f-4d34-b949-8f604a396c86 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:16.168375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369f52-9d3f-4d34-b949-8f604a396c86 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:16.168463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369f52-9d3f-4d34-b949-8f604a396c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:16.214538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ac369f52-9d3f-4d34-b949-8f604a396c86 None None] MFA Rules not processed for user `1ff996f5410b4b11aca1034c992e96f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:16.215871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ac369f52-9d3f-4d34-b949-8f604a396c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:16.308149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1207/2401] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:16.331702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:16.333980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:16.487195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbba415-5f36-4c27-a633-e1e215f98ca3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:16.495824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:16.497086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:16.497538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:16.498029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:16.520799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:16.523391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:16.541035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1195/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:16.892416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:17.504708 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:21.001713 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369f52-9d3f-4d34-b949-8f604a396c86 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:21.015294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369f52-9d3f-4d34-b949-8f604a396c86 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:21.034906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:21.035602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:21.035890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:21.036171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:21.038195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:21.172191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:21.176443 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:21.201973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1208/2403] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:23.315143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:23.316637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:23.536373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4865f6-ef3f-46bf-8a10-9ef77aba7e64 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:23.561456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5119c-0057-4be1-86b0-4945b2243bcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:23.566932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5119c-0057-4be1-86b0-4945b2243bcc service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:23.567558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5119c-0057-4be1-86b0-4945b2243bcc service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:23.571296 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5119c-0057-4be1-86b0-4945b2243bcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:23.587328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f5b5119c-0057-4be1-86b0-4945b2243bcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:23.674769 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5119c-0057-4be1-86b0-4945b2243bcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:23.682054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5119c-0057-4be1-86b0-4945b2243bcc service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:23.731122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1196/2404] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:31.189528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=71 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:32.604798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.620159 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d1529-273e-4356-a681-0d48a1acc501 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.625110 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.626602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.627106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.627854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.630195 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:32.645224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.647054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.662521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1209/2405] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:33.719785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=61,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:40.854336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff4eb-08ac-437d-b95c-271ee2e7e896 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.854336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff4eb-08ac-437d-b95c-271ee2e7e896 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.854336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff4eb-08ac-437d-b95c-271ee2e7e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.873324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-68cff4eb-08ac-437d-b95c-271ee2e7e896 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:40.875064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-68cff4eb-08ac-437d-b95c-271ee2e7e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:40.973226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1197/2406] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:42.655576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:42.833895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.845213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e3455-a43d-40e0-bbee-c94b26bcb6b9 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.849637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.850804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.851824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.852332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.854753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.868615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.870660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.887655 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1210/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:44.023846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cff4eb-08ac-437d-b95c-271ee2e7e896 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:44.050187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cff4eb-08ac-437d-b95c-271ee2e7e896 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:44.060476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9110f0-3bec-4efe-a678-2846b4038f73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:44.062385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9110f0-3bec-4efe-a678-2846b4038f73 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:44.063673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9110f0-3bec-4efe-a678-2846b4038f73 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:44.064207 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9110f0-3bec-4efe-a678-2846b4038f73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:44.089976 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1f9110f0-3bec-4efe-a678-2846b4038f73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:44.119639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9110f0-3bec-4efe-a678-2846b4038f73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:44.124963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9110f0-3bec-4efe-a678-2846b4038f73 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:44.167347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1198/2408] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:48.451296 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.457289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:48.614776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5aa4-cb90-4c97-ac64-0ceda24e547a service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.621778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.623902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.624373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.624814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] PATH_INFO: `/v3/users/0c0a5c8de12349f2949cf2fc549e2336` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.626317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0a5c8de12349f2949cf2fc549e2336)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.630289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.841109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0a5c8de12349f2949cf2fc549e2336'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:48.907050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0a5c8de12349f2949cf2fc549e2336'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:48.926521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0a5c8de12349f2949cf2fc549e2336'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:48.936407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0a5c8de12349f2949cf2fc549e2336'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:48.937402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0a5c8de12349f2949cf2fc549e2336'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:48.946651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1211/2409] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:48 2022] DELETE /identity/v3/users/0c0a5c8de12349f2949cf2fc549e2336 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:48.951379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e7f9f-a409-4be4-b126-0b0094be172e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.951943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e7f9f-a409-4be4-b126-0b0094be172e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.951943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e7f9f-a409-4be4-b126-0b0094be172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.972654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-029e7f9f-a409-4be4-b126-0b0094be172e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:48.974295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-029e7f9f-a409-4be4-b126-0b0094be172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.051095 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1199/2410] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:49.062188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.064298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.140154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8e409-42fa-4bee-b1d5-f021b9488089 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.158449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.160112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.160112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.160112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.173578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.181410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.188046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1212/2411] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:49.480343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e7f9f-a409-4be4-b126-0b0094be172e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.481970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-029e7f9f-a409-4be4-b126-0b0094be172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.503398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e7f9f-a409-4be4-b126-0b0094be172e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.512887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.513986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.514453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.514909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] PATH_INFO: `/v3/projects/8ca47cdc40de45898c2a360302fd6ea6` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.517225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca47cdc40de45898c2a360302fd6ea6)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.519601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.669464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca47cdc40de45898c2a360302fd6ea6', 'request_id': 'req-0d260ff9-c102-4459-94c1-c1566fdc944b'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.757359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca47cdc40de45898c2a360302fd6ea6', 'request_id': 'req-0d260ff9-c102-4459-94c1-c1566fdc944b'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.768531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca47cdc40de45898c2a360302fd6ea6', 'request_id': 'req-0d260ff9-c102-4459-94c1-c1566fdc944b'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.788820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] The token cache is being invalidate because project 8ca47cdc40de45898c2a360302fd6ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:49.789290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.791280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.792440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1200/2412] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:49 2022] DELETE /identity/v3/projects/8ca47cdc40de45898c2a360302fd6ea6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:50.142090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:50.144237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:50.163265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:50.298253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b59b-4c5d-429a-9f8e-2baff14d563a service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:50.442450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:50.443295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:50.443592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:50.443877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:50.452838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:50.467078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:50.468756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:50.481730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1213/2413] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:55.231222 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:55.232794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:55.288433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:55.344256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d260ff9-c102-4459-94c1-c1566fdc944b admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:55.349185 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:55.350401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:55.350686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:55.350966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] PATH_INFO: `/v3/users/f5c252a6f8d54ec9a7338161b25bb016` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:55.353279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c252a6f8d54ec9a7338161b25bb016)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:55.355870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:55.564733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c252a6f8d54ec9a7338161b25bb016'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:55.622926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c252a6f8d54ec9a7338161b25bb016'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:55.652004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c252a6f8d54ec9a7338161b25bb016'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:55.652844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c252a6f8d54ec9a7338161b25bb016'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:55.661123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c252a6f8d54ec9a7338161b25bb016'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:55.668192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1201/2414] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:55 2022] DELETE /identity/v3/users/f5c252a6f8d54ec9a7338161b25bb016 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:56.188963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:56.208262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9be0b9-e784-4505-a9f1-51541170ff55 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:56.287708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:56.288807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.289518 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.290248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] PATH_INFO: `/v3/projects/757c21ac512e42be9ec4d8b2a2134000` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.293018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=757c21ac512e42be9ec4d8b2a2134000)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:56.296380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:56.420969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:56.433030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757c21ac512e42be9ec4d8b2a2134000', 'request_id': 'req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:56.535788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757c21ac512e42be9ec4d8b2a2134000', 'request_id': 'req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:56.547081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757c21ac512e42be9ec4d8b2a2134000', 'request_id': 'req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:56.565889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] The token cache is being invalidate because project 757c21ac512e42be9ec4d8b2a2134000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:56.566205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:56.566902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:56.569016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1214/2415] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:56 2022] DELETE /identity/v3/projects/757c21ac512e42be9ec4d8b2a2134000 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:56.573191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:56.575351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:56.600239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa004-5d3d-4be8-af91-21cc701b1511 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:56.716461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:56.719245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.719998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.720734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] PATH_INFO: `/v3/users/9fe422ef81074dd0890bc1ddbf7ee68a` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.723232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe422ef81074dd0890bc1ddbf7ee68a)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:56.727147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:56.903334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:56.929525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe422ef81074dd0890bc1ddbf7ee68a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:57.000320 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe422ef81074dd0890bc1ddbf7ee68a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:57.029898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe422ef81074dd0890bc1ddbf7ee68a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:57.032377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe422ef81074dd0890bc1ddbf7ee68a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:57.051407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe422ef81074dd0890bc1ddbf7ee68a'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:57.063725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1202/2416] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:56 2022] DELETE /identity/v3/users/9fe422ef81074dd0890bc1ddbf7ee68a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:57.692496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:57.695470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:57.711520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a93e0f-dd13-4d59-9c0b-a8145fcb3c19 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.860959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.862667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.863834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.864586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] PATH_INFO: `/v3/projects/37ae6d70830149fa8fe8f86cb8f80cf8` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:57.867047 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ae6d70830149fa8fe8f86cb8f80cf8)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:57.877029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.015237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ae6d70830149fa8fe8f86cb8f80cf8', 'request_id': 'req-a161755e-cdc6-4389-bdb9-428e4d70cb88'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:58.066344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.068684 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:58.135619 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ae6d70830149fa8fe8f86cb8f80cf8', 'request_id': 'req-a161755e-cdc6-4389-bdb9-428e4d70cb88'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:58.144707 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ae6d70830149fa8fe8f86cb8f80cf8', 'request_id': 'req-a161755e-cdc6-4389-bdb9-428e4d70cb88'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:58.157856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] The token cache is being invalidate because project 37ae6d70830149fa8fe8f86cb8f80cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:58.158597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:58.160860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-a161755e-cdc6-4389-bdb9-428e4d70cb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:58.170274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1215/2417] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:57 2022] DELETE /identity/v3/projects/37ae6d70830149fa8fe8f86cb8f80cf8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:58.176203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0199-8fcf-4292-9e4d-de2bbde2a328 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.176892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0199-8fcf-4292-9e4d-de2bbde2a328 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.177396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0199-8fcf-4292-9e4d-de2bbde2a328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.189895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d45cb-d498-421b-9855-4e94527cffe0 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.213163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-48fb0199-8fcf-4292-9e4d-de2bbde2a328 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:58.217044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-48fb0199-8fcf-4292-9e4d-de2bbde2a328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:58.302868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:58.308274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.308963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.309402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.309688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.313015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:58.328802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.331279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.335525 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1216/2418] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:58.343089 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67dc13-84cf-446b-9c28-5a9ac2b8c00c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.344064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67dc13-84cf-446b-9c28-5a9ac2b8c00c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.344452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67dc13-84cf-446b-9c28-5a9ac2b8c00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.356645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1203/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:58.367329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6d67dc13-84cf-446b-9c28-5a9ac2b8c00c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:58.368688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6d67dc13-84cf-446b-9c28-5a9ac2b8c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:58.379706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1217/2420] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:58.385545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.400049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13365ab2-0a95-409b-85a2-1f09eba78814 service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.407653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.419637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.419637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.419637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.419637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:58.419637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.419637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.434240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1204/2421] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:58.437903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67dc13-84cf-446b-9c28-5a9ac2b8c00c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.462125 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67dc13-84cf-446b-9c28-5a9ac2b8c00c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.475501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.483697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.484211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.485102 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.486124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.488806 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.699963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1218/2422] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:58 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:58.700948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.723816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7e17-eb62-475d-9d2b-8a00acec474e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.779684 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:58.819228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42cbf0-27d9-4f76-869a-0c0374e1723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.820014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42cbf0-27d9-4f76-869a-0c0374e1723e admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.820365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42cbf0-27d9-4f76-869a-0c0374e1723e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.820711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42cbf0-27d9-4f76-869a-0c0374e1723e admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.821478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42cbf0-27d9-4f76-869a-0c0374e1723e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.823659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42cbf0-27d9-4f76-869a-0c0374e1723e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.924038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.927429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:58.943327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1205/2423] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:58 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:58.947733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42cbf0-27d9-4f76-869a-0c0374e1723e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.959416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded8afd-ea64-4797-921a-c0357c1f444c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.969990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42cbf0-27d9-4f76-869a-0c0374e1723e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.972096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.973312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.973760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.974569 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] PATH_INFO: `/v3/users/e9a039aa8d2e4f2a9f3de244b051b485` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.978814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a039aa8d2e4f2a9f3de244b051b485)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.980252 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3198a-1810-4959-95d6-dcba341f7260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.985977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.994498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3198a-1810-4959-95d6-dcba341f7260 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.994910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3198a-1810-4959-95d6-dcba341f7260 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.995255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3198a-1810-4959-95d6-dcba341f7260 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.998913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3198a-1810-4959-95d6-dcba341f7260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.007753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3198a-1810-4959-95d6-dcba341f7260 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.029449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1206/2424] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:59.037721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3198a-1810-4959-95d6-dcba341f7260 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.063858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3198a-1810-4959-95d6-dcba341f7260 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.073570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb274bd0-dea4-4a09-ba9f-30cc2f1ab831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.075209 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274bd0-dea4-4a09-ba9f-30cc2f1ab831 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.075510 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274bd0-dea4-4a09-ba9f-30cc2f1ab831 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.076125 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274bd0-dea4-4a09-ba9f-30cc2f1ab831 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.077576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb274bd0-dea4-4a09-ba9f-30cc2f1ab831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.080336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb274bd0-dea4-4a09-ba9f-30cc2f1ab831 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.094166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1207/2425] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:59.098558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb274bd0-dea4-4a09-ba9f-30cc2f1ab831 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.112904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb274bd0-dea4-4a09-ba9f-30cc2f1ab831 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.119873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6b096-5138-4a84-ad77-f5cfbeef6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.121290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b096-5138-4a84-ad77-f5cfbeef6e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.121646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b096-5138-4a84-ad77-f5cfbeef6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.122282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b096-5138-4a84-ad77-f5cfbeef6e80 admin admin] PATH_INFO: `/v3/projects/d8f7faef6eb847fe8c8d243662105271/users/ffd80d442d404aaa95e88bac7a937ca2/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.153292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6b096-5138-4a84-ad77-f5cfbeef6e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f7faef6eb847fe8c8d243662105271, user_id=ffd80d442d404aaa95e88bac7a937ca2, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.157805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6b096-5138-4a84-ad77-f5cfbeef6e80 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.208907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a039aa8d2e4f2a9f3de244b051b485'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:59.284318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1208/2426] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:59 2022] PUT /identity/v3/projects/d8f7faef6eb847fe8c8d243662105271/users/ffd80d442d404aaa95e88bac7a937ca2/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:59.289690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9287f-9f8e-46f8-b2aa-e67e4ad0eb24 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.290090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9287f-9f8e-46f8-b2aa-e67e4ad0eb24 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.290469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9287f-9f8e-46f8-b2aa-e67e4ad0eb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.312164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-36c9287f-9f8e-46f8-b2aa-e67e4ad0eb24 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:59.313066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a039aa8d2e4f2a9f3de244b051b485'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:59.314411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-36c9287f-9f8e-46f8-b2aa-e67e4ad0eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:59.333140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a039aa8d2e4f2a9f3de244b051b485'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:59.340643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a039aa8d2e4f2a9f3de244b051b485'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:59.341392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-291e41e3-ed62-406b-86a4-4aabf5f1eae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a039aa8d2e4f2a9f3de244b051b485'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:59.348321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1219/2427] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:58 2022] DELETE /identity/v3/users/e9a039aa8d2e4f2a9f3de244b051b485 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:59.353066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428a523-bf34-4a10-ab68-97b82ebc53f3 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.353478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428a523-bf34-4a10-ab68-97b82ebc53f3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.353851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428a523-bf34-4a10-ab68-97b82ebc53f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.375547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5428a523-bf34-4a10-ab68-97b82ebc53f3 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:59.379265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5428a523-bf34-4a10-ab68-97b82ebc53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:59.382600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1209/2428] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:59.393176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9287f-9f8e-46f8-b2aa-e67e4ad0eb24 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.394619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-36c9287f-9f8e-46f8-b2aa-e67e4ad0eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:59.474999 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9287f-9f8e-46f8-b2aa-e67e4ad0eb24 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.486061 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1220/2429] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:59.514373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428a523-bf34-4a10-ab68-97b82ebc53f3 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.516138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5428a523-bf34-4a10-ab68-97b82ebc53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:59.566235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.567008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.567672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.567672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.587655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.589176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.598822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428a523-bf34-4a10-ab68-97b82ebc53f3 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.600894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1210/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:59.603888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be058a0-375e-4649-b04b-db0af3ebf464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.607063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be058a0-375e-4649-b04b-db0af3ebf464 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.607063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be058a0-375e-4649-b04b-db0af3ebf464 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.607063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be058a0-375e-4649-b04b-db0af3ebf464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.616537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be058a0-375e-4649-b04b-db0af3ebf464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.618275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be058a0-375e-4649-b04b-db0af3ebf464 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.632627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1221/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:58:00.039089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:00.040600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:00.070527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece6432-72be-475f-9ee7-ff4a38b66940 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:00.075135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:00.076073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.076518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.076955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] PATH_INFO: `/v3/projects/34e0e20ac70746f0925067fc107ad9bf` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.079749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e0e20ac70746f0925067fc107ad9bf)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:00.082526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:00.227066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:00.275874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e0e20ac70746f0925067fc107ad9bf', 'request_id': 'req-8cabfbfd-f094-40e4-9e78-3348b71e2cff'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.352922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e0e20ac70746f0925067fc107ad9bf', 'request_id': 'req-8cabfbfd-f094-40e4-9e78-3348b71e2cff'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.360627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e0e20ac70746f0925067fc107ad9bf', 'request_id': 'req-8cabfbfd-f094-40e4-9e78-3348b71e2cff'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.377425 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] The token cache is being invalidate because project 34e0e20ac70746f0925067fc107ad9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:00.379839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.379839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8cabfbfd-f094-40e4-9e78-3348b71e2cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.382322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1211/2432] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:00 2022] DELETE /identity/v3/projects/34e0e20ac70746f0925067fc107ad9bf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:00.386830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c443-bdf0-4953-905c-1b1074c0c086 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.387387 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c443-bdf0-4953-905c-1b1074c0c086 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.387828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c443-bdf0-4953-905c-1b1074c0c086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.421280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-dfd6c443-bdf0-4953-905c-1b1074c0c086 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:00.425150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-dfd6c443-bdf0-4953-905c-1b1074c0c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:00.530466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1222/2433] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:00.533106 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f46e6-93a2-4ff9-9763-7bd75e6c3674 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.534189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f46e6-93a2-4ff9-9763-7bd75e6c3674 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.538612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f46e6-93a2-4ff9-9763-7bd75e6c3674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.570630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0b8f46e6-93a2-4ff9-9763-7bd75e6c3674 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:00.572362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0b8f46e6-93a2-4ff9-9763-7bd75e6c3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:00.590135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1212/2434] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:00.595194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6c443-bdf0-4953-905c-1b1074c0c086 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:00.607372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6c443-bdf0-4953-905c-1b1074c0c086 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:00.616018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:00.617643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.617643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.617643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.618396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:00.618714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:00.620486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:00.640698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1223/2435] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:00.641635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f46e6-93a2-4ff9-9763-7bd75e6c3674 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:00.657385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f46e6-93a2-4ff9-9763-7bd75e6c3674 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:00.664285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfd2b8-6a3c-4159-a45f-0f86190a86a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:00.665035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfd2b8-6a3c-4159-a45f-0f86190a86a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.665315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfd2b8-6a3c-4159-a45f-0f86190a86a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.665590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfd2b8-6a3c-4159-a45f-0f86190a86a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.666390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfd2b8-6a3c-4159-a45f-0f86190a86a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:00.670396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfd2b8-6a3c-4159-a45f-0f86190a86a8 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:00.868360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1213/2436] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:00 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:00.872422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:00.885278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104252b2-53e1-43e5-ab11-ad5bfbcb467e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:00.979346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71331e9-f54b-47f6-8e70-98d468c53517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:00.980236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71331e9-f54b-47f6-8e70-98d468c53517 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.980596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71331e9-f54b-47f6-8e70-98d468c53517 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.981012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71331e9-f54b-47f6-8e70-98d468c53517 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.982215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71331e9-f54b-47f6-8e70-98d468c53517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:00.985904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71331e9-f54b-47f6-8e70-98d468c53517 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.105592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:01.110394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1224/2437] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:00 2022] POST /identity/v3/users => generated 281 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:01.114277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfd2b8-6a3c-4159-a45f-0f86190a86a8 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.129483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfd2b8-6a3c-4159-a45f-0f86190a86a8 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.135596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546ab8c-40c5-4d56-a0d9-7ff7e0be471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.138661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546ab8c-40c5-4d56-a0d9-7ff7e0be471f admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.138661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546ab8c-40c5-4d56-a0d9-7ff7e0be471f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.138661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546ab8c-40c5-4d56-a0d9-7ff7e0be471f admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.143795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546ab8c-40c5-4d56-a0d9-7ff7e0be471f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.146332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546ab8c-40c5-4d56-a0d9-7ff7e0be471f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.184236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1214/2438] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:58:01.189381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71331e9-f54b-47f6-8e70-98d468c53517 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.212920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71331e9-f54b-47f6-8e70-98d468c53517 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.220830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87342a2-7419-4b6c-8086-2c168b20e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.222060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87342a2-7419-4b6c-8086-2c168b20e7bb admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.222491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87342a2-7419-4b6c-8086-2c168b20e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.222836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87342a2-7419-4b6c-8086-2c168b20e7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.224005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87342a2-7419-4b6c-8086-2c168b20e7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.225441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87342a2-7419-4b6c-8086-2c168b20e7bb admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.241017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1225/2439] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:58:01.244109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546ab8c-40c5-4d56-a0d9-7ff7e0be471f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.258093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546ab8c-40c5-4d56-a0d9-7ff7e0be471f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.268865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.271705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.272312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.272757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] PATH_INFO: `/v3/projects/ceff3919fcf7438b90c8b7466b4d7eaa/users/f209d928f59e45a7b7c3636bdb698ea6/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.297424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceff3919fcf7438b90c8b7466b4d7eaa, user_id=f209d928f59e45a7b7c3636bdb698ea6, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.303298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.427741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1215/2440] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:01 2022] PUT /identity/v3/projects/ceff3919fcf7438b90c8b7466b4d7eaa/users/f209d928f59e45a7b7c3636bdb698ea6/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:01.432405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6632a-f6fe-433c-bb30-1c4f28931692 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.433080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6632a-f6fe-433c-bb30-1c4f28931692 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.433546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6632a-f6fe-433c-bb30-1c4f28931692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.511868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-abd6632a-f6fe-433c-bb30-1c4f28931692 None None] MFA Rules not processed for user `f209d928f59e45a7b7c3636bdb698ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:01.514019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-abd6632a-f6fe-433c-bb30-1c4f28931692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:01.687877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1226/2441] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:58:01.713804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.716091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:01.895281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6591e0-1f6d-4a89-8464-029505db18f0 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.900917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8ed66-e302-400f-9451-78a7b3468124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.902060 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8ed66-e302-400f-9451-78a7b3468124 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.904271 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8ed66-e302-400f-9451-78a7b3468124 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.904681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8ed66-e302-400f-9451-78a7b3468124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.919167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8ed66-e302-400f-9451-78a7b3468124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.921000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8ed66-e302-400f-9451-78a7b3468124 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.935838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1216/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:02.564524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:02.633409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:07.849349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6632a-f6fe-433c-bb30-1c4f28931692 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:07.850899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-abd6632a-f6fe-433c-bb30-1c4f28931692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:08.027584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6632a-f6fe-433c-bb30-1c4f28931692 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:08.048959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:08.050737 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:08.051035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:08.052621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:08.058298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:08.091415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:08.093123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:08.125754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1227/2443] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:10.628811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8972-90a8-47c3-bbae-6019d8134685 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.629309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8972-90a8-47c3-bbae-6019d8134685 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.629404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8972-90a8-47c3-bbae-6019d8134685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.685915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-f0ff8972-90a8-47c3-bbae-6019d8134685 None None] MFA Rules not processed for user `ffd80d442d404aaa95e88bac7a937ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:10.691620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f0ff8972-90a8-47c3-bbae-6019d8134685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:10.858414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1217/2444] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:10.865397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.865397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:11.008570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96553d16-e50b-4366-ae99-4e24197de388 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.017640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39af8f4-9c7b-4758-afd1-b104d342b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.018372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af8f4-9c7b-4758-afd1-b104d342b504 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.018773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af8f4-9c7b-4758-afd1-b104d342b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.019037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af8f4-9c7b-4758-afd1-b104d342b504 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.019795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af8f4-9c7b-4758-afd1-b104d342b504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.021807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af8f4-9c7b-4758-afd1-b104d342b504 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.188342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1228/2445] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:10 2022] POST /identity/v3/projects => generated 379 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:11.196022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff8972-90a8-47c3-bbae-6019d8134685 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:11.211094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff8972-90a8-47c3-bbae-6019d8134685 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.286300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b8a8d-106f-4af2-b624-b284204bf76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.287101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b8a8d-106f-4af2-b624-b284204bf76d admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.287350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b8a8d-106f-4af2-b624-b284204bf76d admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.287629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b8a8d-106f-4af2-b624-b284204bf76d admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.289012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b8a8d-106f-4af2-b624-b284204bf76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.291311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b8a8d-106f-4af2-b624-b284204bf76d admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.411599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1218/2446] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:11 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:11.415826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39af8f4-9c7b-4758-afd1-b104d342b504 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:11.449767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39af8f4-9c7b-4758-afd1-b104d342b504 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.458914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3df9e9-f622-41aa-bf31-1a77a9cd3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.461420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3df9e9-f622-41aa-bf31-1a77a9cd3708 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.461916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3df9e9-f622-41aa-bf31-1a77a9cd3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.469702 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3df9e9-f622-41aa-bf31-1a77a9cd3708 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.472028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3df9e9-f622-41aa-bf31-1a77a9cd3708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.477958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3df9e9-f622-41aa-bf31-1a77a9cd3708 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.518636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1229/2447] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:11.522747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b8a8d-106f-4af2-b624-b284204bf76d admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:11.540588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b8a8d-106f-4af2-b624-b284204bf76d admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.571434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ded0b-4fd5-463f-a773-45366a9edca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.572459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ded0b-4fd5-463f-a773-45366a9edca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.572685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ded0b-4fd5-463f-a773-45366a9edca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.572969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ded0b-4fd5-463f-a773-45366a9edca7 admin admin] PATH_INFO: `/v3/projects/7174ce9837e74ba4b6b80ffbedb44d30/users/be8b507ebb084cb2882b77a93e0c4ce3/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.606503 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ded0b-4fd5-463f-a773-45366a9edca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7174ce9837e74ba4b6b80ffbedb44d30, user_id=be8b507ebb084cb2882b77a93e0c4ce3, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.610076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ded0b-4fd5-463f-a773-45366a9edca7 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.751753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1219/2448] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:11 2022] PUT /identity/v3/projects/7174ce9837e74ba4b6b80ffbedb44d30/users/be8b507ebb084cb2882b77a93e0c4ce3/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:11.755695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3df9e9-f622-41aa-bf31-1a77a9cd3708 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:11.769786 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3df9e9-f622-41aa-bf31-1a77a9cd3708 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.829664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:11.881064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cc9fc-8d67-4069-93ad-ee01a616db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.882797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc9fc-8d67-4069-93ad-ee01a616db51 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.883293 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc9fc-8d67-4069-93ad-ee01a616db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.883651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc9fc-8d67-4069-93ad-ee01a616db51 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.885311 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc9fc-8d67-4069-93ad-ee01a616db51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.888042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc9fc-8d67-4069-93ad-ee01a616db51 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.909856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1230/2449] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:11.911436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ded0b-4fd5-463f-a773-45366a9edca7 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:11.927461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ded0b-4fd5-463f-a773-45366a9edca7 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.932962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.934659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.935015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.935478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] PATH_INFO: `/v3/projects/7174ce9837e74ba4b6b80ffbedb44d30/users/be8b507ebb084cb2882b77a93e0c4ce3/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.938227 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7174ce9837e74ba4b6b80ffbedb44d30, user_id=be8b507ebb084cb2882b77a93e0c4ce3, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.941833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.982557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1220/2450] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:11 2022] PUT /identity/v3/projects/7174ce9837e74ba4b6b80ffbedb44d30/users/be8b507ebb084cb2882b77a93e0c4ce3/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:21.952805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:22.380645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=13 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:22.464149 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee8e5-2a4e-44d3-916e-98a36e6ed1f4 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:22.465370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee8e5-2a4e-44d3-916e-98a36e6ed1f4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:22.466148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee8e5-2a4e-44d3-916e-98a36e6ed1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:22.527192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-302ee8e5-2a4e-44d3-916e-98a36e6ed1f4 None None] MFA Rules not processed for user `be8b507ebb084cb2882b77a93e0c4ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:22.529271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-302ee8e5-2a4e-44d3-916e-98a36e6ed1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:22.806770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1231/2451] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:22.828872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:22.832442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:23.022221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ef00f-08eb-4098-9241-ad7eca657acd admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:23.038923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79ee60-6ded-45bf-8e74-8d93f62b8383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:23.040142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ee60-6ded-45bf-8e74-8d93f62b8383 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:23.040664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ee60-6ded-45bf-8e74-8d93f62b8383 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:23.041184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ee60-6ded-45bf-8e74-8d93f62b8383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:23.156902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79ee60-6ded-45bf-8e74-8d93f62b8383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:23.164244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79ee60-6ded-45bf-8e74-8d93f62b8383 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:23.177811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1221/2452] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:31.432168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee8e5-2a4e-44d3-916e-98a36e6ed1f4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:31.536612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee8e5-2a4e-44d3-916e-98a36e6ed1f4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:31.542833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:31.543793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.544247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.544808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] PATH_INFO: `/v3/users/f209d928f59e45a7b7c3636bdb698ea6` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.557317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f209d928f59e45a7b7c3636bdb698ea6)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:31.560674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:31.766346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f209d928f59e45a7b7c3636bdb698ea6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:31.865070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f209d928f59e45a7b7c3636bdb698ea6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:31.890874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f209d928f59e45a7b7c3636bdb698ea6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:31.904392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f209d928f59e45a7b7c3636bdb698ea6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:31.905869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f209d928f59e45a7b7c3636bdb698ea6'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:31.916591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1232/2453] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:31 2022] DELETE /identity/v3/users/f209d928f59e45a7b7c3636bdb698ea6 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:31.919379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af22d-2185-4831-a1b3-5c18922b2daa None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.919860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af22d-2185-4831-a1b3-5c18922b2daa None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.919994 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af22d-2185-4831-a1b3-5c18922b2daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.943811 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-853af22d-2185-4831-a1b3-5c18922b2daa None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:31.945208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-853af22d-2185-4831-a1b3-5c18922b2daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:32.054522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1222/2454] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:32.101271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:32.103980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:32.116954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:32.218969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80c3a2-55f4-46f9-a8bf-8f7b803f3d44 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:32.232389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:32.233639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:32.235409 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:32.236974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:32.275754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:32.278425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:32.294235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1233/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:32.857443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af22d-2185-4831-a1b3-5c18922b2daa None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:32.861793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-853af22d-2185-4831-a1b3-5c18922b2daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:32.880917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af22d-2185-4831-a1b3-5c18922b2daa None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:32.891182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:32.895475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:32.896108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:32.897558 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] PATH_INFO: `/v3/projects/ceff3919fcf7438b90c8b7466b4d7eaa` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:32.900992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceff3919fcf7438b90c8b7466b4d7eaa)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:32.904037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:33.085449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:33.113314 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceff3919fcf7438b90c8b7466b4d7eaa', 'request_id': 'req-94b663d4-7aae-46bc-af85-16f53b303f86'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.186616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceff3919fcf7438b90c8b7466b4d7eaa', 'request_id': 'req-94b663d4-7aae-46bc-af85-16f53b303f86'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.200133 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceff3919fcf7438b90c8b7466b4d7eaa', 'request_id': 'req-94b663d4-7aae-46bc-af85-16f53b303f86'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.227577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] The token cache is being invalidate because project ceff3919fcf7438b90c8b7466b4d7eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:33.228153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.229294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-94b663d4-7aae-46bc-af85-16f53b303f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.235462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1223/2456] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:32 2022] DELETE /identity/v3/projects/ceff3919fcf7438b90c8b7466b4d7eaa => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:34.427352 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:34.431188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:34.462091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbcae1-d773-4f45-bbe6-09544060462e service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:34.637550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:34.640805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:34.652654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:34.652654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] PATH_INFO: `/v3/users/1ff996f5410b4b11aca1034c992e96f5` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:34.652654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff996f5410b4b11aca1034c992e96f5)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:34.652654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:34.896608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff996f5410b4b11aca1034c992e96f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:34.986456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff996f5410b4b11aca1034c992e96f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.015064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff996f5410b4b11aca1034c992e96f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.046066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff996f5410b4b11aca1034c992e96f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.047623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff996f5410b4b11aca1034c992e96f5'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.069217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07127919-d2c8-42e8-9961-fc7030d1c758 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.069847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07127919-d2c8-42e8-9961-fc7030d1c758 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.069944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1234/2457] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:34 2022] DELETE /identity/v3/users/1ff996f5410b4b11aca1034c992e96f5 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:35.070038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07127919-d2c8-42e8-9961-fc7030d1c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.099378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-07127919-d2c8-42e8-9961-fc7030d1c758 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:35.100862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-07127919-d2c8-42e8-9961-fc7030d1c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:35.191000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1224/2458] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:35.201262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:35.203566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:35.280435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:35.329365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9400a-5476-4d2b-86c6-2b99bd0f6c60 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:35.336875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cfebe-95ea-4823-bb55-d3aa9b759d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:35.337872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cfebe-95ea-4823-bb55-d3aa9b759d91 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.338186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cfebe-95ea-4823-bb55-d3aa9b759d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.338469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cfebe-95ea-4823-bb55-d3aa9b759d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.350453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cfebe-95ea-4823-bb55-d3aa9b759d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:35.353299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cfebe-95ea-4823-bb55-d3aa9b759d91 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:35.368692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1235/2459] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:35.835484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07127919-d2c8-42e8-9961-fc7030d1c758 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:35.836714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-07127919-d2c8-42e8-9961-fc7030d1c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:35.884632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07127919-d2c8-42e8-9961-fc7030d1c758 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:35.906507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:35.908932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.920562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.924226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] PATH_INFO: `/v3/projects/b6144015b19b43f680ff1185ad11801d` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.924226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6144015b19b43f680ff1185ad11801d)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:35.938662 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:36.205019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6144015b19b43f680ff1185ad11801d', 'request_id': 'req-4283850f-73e6-42db-be7c-15d5d9f9971c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:36.271851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6144015b19b43f680ff1185ad11801d', 'request_id': 'req-4283850f-73e6-42db-be7c-15d5d9f9971c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:36.278899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6144015b19b43f680ff1185ad11801d', 'request_id': 'req-4283850f-73e6-42db-be7c-15d5d9f9971c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:36.293097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] The token cache is being invalidate because project b6144015b19b43f680ff1185ad11801d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:36.293530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:36.294562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-4283850f-73e6-42db-be7c-15d5d9f9971c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:36.298082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1225/2460] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:35 2022] DELETE /identity/v3/projects/b6144015b19b43f680ff1185ad11801d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:36.306608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2ba4a-90b9-484f-858f-5fbf567d43c8 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.307194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2ba4a-90b9-484f-858f-5fbf567d43c8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.307194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2ba4a-90b9-484f-858f-5fbf567d43c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.328917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0ac2ba4a-90b9-484f-858f-5fbf567d43c8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:36.331067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0ac2ba4a-90b9-484f-858f-5fbf567d43c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:36.427815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1236/2461] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:36.434724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafa332-fba4-466a-8652-db73bcc4da72 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.435083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafa332-fba4-466a-8652-db73bcc4da72 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.435430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafa332-fba4-466a-8652-db73bcc4da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.463164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0dafa332-fba4-466a-8652-db73bcc4da72 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:36.465170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0dafa332-fba4-466a-8652-db73bcc4da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:36.477989 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1226/2462] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:36.483095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2ba4a-90b9-484f-858f-5fbf567d43c8 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:36.500675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2ba4a-90b9-484f-858f-5fbf567d43c8 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:36.510065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:36.511201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.516804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.516804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.516804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:36.516804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:36.516804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:36.554364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1237/2463] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:36.556592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafa332-fba4-466a-8652-db73bcc4da72 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:36.570732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafa332-fba4-466a-8652-db73bcc4da72 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:36.578524 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6a84-fa98-4568-85af-d0a05cf2d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:36.579536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6a84-fa98-4568-85af-d0a05cf2d7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.579990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6a84-fa98-4568-85af-d0a05cf2d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.580272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6a84-fa98-4568-85af-d0a05cf2d7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.580969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b6a84-fa98-4568-85af-d0a05cf2d7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:36.587656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b6a84-fa98-4568-85af-d0a05cf2d7e2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:36.693812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1227/2464] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:36 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:36.694167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:36.709866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895a097-214f-40b7-a4e1-27caecaea36e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:36.847444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcab2f-e8fb-48d7-987e-ebfce3a44dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:36.848559 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcab2f-e8fb-48d7-987e-ebfce3a44dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.848913 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcab2f-e8fb-48d7-987e-ebfce3a44dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.849292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcab2f-e8fb-48d7-987e-ebfce3a44dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.850167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcab2f-e8fb-48d7-987e-ebfce3a44dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:36.852233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcab2f-e8fb-48d7-987e-ebfce3a44dc3 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:36.916479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1238/2465] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:36 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:58:36.920298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6a84-fa98-4568-85af-d0a05cf2d7e2 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:36.938061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6a84-fa98-4568-85af-d0a05cf2d7e2 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:36.944550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc31c07-d065-4bdc-b84b-a26ef205ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:36.945674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31c07-d065-4bdc-b84b-a26ef205ea06 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.946031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31c07-d065-4bdc-b84b-a26ef205ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.946453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31c07-d065-4bdc-b84b-a26ef205ea06 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.947892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc31c07-d065-4bdc-b84b-a26ef205ea06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:36.949729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc31c07-d065-4bdc-b84b-a26ef205ea06 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:36.966960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1228/2466] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:58:36.979066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcab2f-e8fb-48d7-987e-ebfce3a44dc3 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:36.993900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcab2f-e8fb-48d7-987e-ebfce3a44dc3 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:36.999877 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c0cd5-4983-4a4f-a1dc-7999d0fec51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:37.000960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c0cd5-4983-4a4f-a1dc-7999d0fec51d admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:37.001121 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c0cd5-4983-4a4f-a1dc-7999d0fec51d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:37.001423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c0cd5-4983-4a4f-a1dc-7999d0fec51d admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:37.002185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c0cd5-4983-4a4f-a1dc-7999d0fec51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:37.003799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c0cd5-4983-4a4f-a1dc-7999d0fec51d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:37.017317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1239/2467] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:37.023484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc31c07-d065-4bdc-b84b-a26ef205ea06 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:37.034298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:37.038401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc31c07-d065-4bdc-b84b-a26ef205ea06 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:37.053526 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:37.054571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:37.054860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:37.055135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] PATH_INFO: `/v3/projects/71ace975200e4f7ab813e2fea2f07298/users/12e6b6ec3cbb47d791b9d93cc5b61898/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:37.074972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ace975200e4f7ab813e2fea2f07298, user_id=12e6b6ec3cbb47d791b9d93cc5b61898, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:37.078830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:37.206183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e4ef-208c-42d7-a696-a8008a135dd5 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:37.206183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e4ef-208c-42d7-a696-a8008a135dd5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:37.206183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e4ef-208c-42d7-a696-a8008a135dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:37.206574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1229/2468] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:37 2022] PUT /identity/v3/projects/71ace975200e4f7ab813e2fea2f07298/users/12e6b6ec3cbb47d791b9d93cc5b61898/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:37.251473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1bc1e4ef-208c-42d7-a696-a8008a135dd5 None None] MFA Rules not processed for user `12e6b6ec3cbb47d791b9d93cc5b61898`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:37.252731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1bc1e4ef-208c-42d7-a696-a8008a135dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:37.338836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:37.416979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1240/2469] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:37.443792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:37.445996 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:37.588862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ef50-bb8e-40c9-bbb2-96e28325da37 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:37.602740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:37.604017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:37.604017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:37.604017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:37.627673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:37.629182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:37.665773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1230/2470] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:47.531502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712d124-2932-4bb9-aec6-eb7df9e0f1e7 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:47.531502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712d124-2932-4bb9-aec6-eb7df9e0f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:47.531502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712d124-2932-4bb9-aec6-eb7df9e0f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:47.567905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0712d124-2932-4bb9-aec6-eb7df9e0f1e7 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:47.569118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0712d124-2932-4bb9-aec6-eb7df9e0f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:47.686659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1241/2471] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:47.718476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:57.670958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=53 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:06.118845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:06.120607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:06.277584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c58a6-bfd5-46d2-b7e1-401fe6257e49 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:06.284374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:06.285668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:06.285955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:06.286272 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] PATH_INFO: `/v3/users/d8855248a97d43148e8702065ee62565` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:06.287616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8855248a97d43148e8702065ee62565)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:06.290096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:06.543100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8855248a97d43148e8702065ee62565'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:06.619822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8855248a97d43148e8702065ee62565'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:06.634714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8855248a97d43148e8702065ee62565'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:06.635461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8855248a97d43148e8702065ee62565'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:06.643827 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8855248a97d43148e8702065ee62565'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:06.650018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1231/2472] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:06 2022] DELETE /identity/v3/users/d8855248a97d43148e8702065ee62565 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:06.654660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a633b74-27fb-4e89-a227-d9cfa894e27f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:06.655198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a633b74-27fb-4e89-a227-d9cfa894e27f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:06.655198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a633b74-27fb-4e89-a227-d9cfa894e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:06.681636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1a633b74-27fb-4e89-a227-d9cfa894e27f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:06.683741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1a633b74-27fb-4e89-a227-d9cfa894e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:06.755685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1242/2473] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:59:06.767762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:06.769220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:06.820909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:06.923202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09bdc2-cd4c-47ea-abd4-092cf0ad3243 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:06.927886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40025e-0e5e-4dd4-9799-3e16cbd57dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:06.931931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40025e-0e5e-4dd4-9799-3e16cbd57dfd service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:06.931931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40025e-0e5e-4dd4-9799-3e16cbd57dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:06.931931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40025e-0e5e-4dd4-9799-3e16cbd57dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:06.942508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40025e-0e5e-4dd4-9799-3e16cbd57dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:06.944835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40025e-0e5e-4dd4-9799-3e16cbd57dfd service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:06.961620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1232/2474] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:07.805501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a633b74-27fb-4e89-a227-d9cfa894e27f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:07.807508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1a633b74-27fb-4e89-a227-d9cfa894e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:07.828476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a633b74-27fb-4e89-a227-d9cfa894e27f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:07.835303 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:07.841722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:07.841722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:07.841722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] PATH_INFO: `/v3/projects/78cc4792e4b94256a71ad776fad630ab` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:07.841722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cc4792e4b94256a71ad776fad630ab)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:07.841722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:08.011910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cc4792e4b94256a71ad776fad630ab', 'request_id': 'req-aad02557-61b4-4010-ba1b-71eda6c6b94b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:08.185556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cc4792e4b94256a71ad776fad630ab', 'request_id': 'req-aad02557-61b4-4010-ba1b-71eda6c6b94b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:08.193119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cc4792e4b94256a71ad776fad630ab', 'request_id': 'req-aad02557-61b4-4010-ba1b-71eda6c6b94b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:08.205037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] The token cache is being invalidate because project 78cc4792e4b94256a71ad776fad630ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:08.205336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:08.206028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-aad02557-61b4-4010-ba1b-71eda6c6b94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:08.207666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1243/2475] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:07 2022] DELETE /identity/v3/projects/78cc4792e4b94256a71ad776fad630ab => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:08.212849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d15a-1983-4037-a8a9-3054e6c31d24 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.213331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d15a-1983-4037-a8a9-3054e6c31d24 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.213446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d15a-1983-4037-a8a9-3054e6c31d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.272291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d374d15a-1983-4037-a8a9-3054e6c31d24 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:08.273670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d374d15a-1983-4037-a8a9-3054e6c31d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:08.338607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1233/2476] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:59:08.348259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7efad2-46f6-42da-bd9a-4622cb027bab None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.348623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7efad2-46f6-42da-bd9a-4622cb027bab None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.348978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7efad2-46f6-42da-bd9a-4622cb027bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.370284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-8f7efad2-46f6-42da-bd9a-4622cb027bab None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:08.371733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8f7efad2-46f6-42da-bd9a-4622cb027bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:08.380188 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1244/2477] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:08.384590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d15a-1983-4037-a8a9-3054e6c31d24 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:08.395702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d15a-1983-4037-a8a9-3054e6c31d24 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:08.400666 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:08.401330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.401611 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.401985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.402765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:59:08.403075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:08.405486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:08.421512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1234/2478] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:59:08.425124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7efad2-46f6-42da-bd9a-4622cb027bab None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:08.438875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7efad2-46f6-42da-bd9a-4622cb027bab None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:08.444896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248cf99-9a02-45b5-af08-58a09dc2ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:08.448330 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248cf99-9a02-45b5-af08-58a09dc2ea8f admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.448626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248cf99-9a02-45b5-af08-58a09dc2ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.448858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248cf99-9a02-45b5-af08-58a09dc2ea8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.449549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248cf99-9a02-45b5-af08-58a09dc2ea8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:08.452337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248cf99-9a02-45b5-af08-58a09dc2ea8f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:08.602977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1245/2479] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:08 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:08.609660 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:08.621221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3c683-18cb-4d2d-946f-bc1893d734c4 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:08.686299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:08.692469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17de0e-cbe2-4673-abe4-28fa34d421fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:08.693160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17de0e-cbe2-4673-abe4-28fa34d421fb admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.693448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17de0e-cbe2-4673-abe4-28fa34d421fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.693729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17de0e-cbe2-4673-abe4-28fa34d421fb admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.694531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17de0e-cbe2-4673-abe4-28fa34d421fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:08.696497 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17de0e-cbe2-4673-abe4-28fa34d421fb admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:08.811425 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1235/2480] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:08 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:08.815396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248cf99-9a02-45b5-af08-58a09dc2ea8f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:08.826488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248cf99-9a02-45b5-af08-58a09dc2ea8f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:08.831541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad627291-bc66-41be-b166-a07681e4e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:08.833551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad627291-bc66-41be-b166-a07681e4e6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.833551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad627291-bc66-41be-b166-a07681e4e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.833551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad627291-bc66-41be-b166-a07681e4e6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.833852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad627291-bc66-41be-b166-a07681e4e6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:08.835386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad627291-bc66-41be-b166-a07681e4e6d8 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:08.847621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1246/2481] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:08.851793 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17de0e-cbe2-4673-abe4-28fa34d421fb admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:08.863674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17de0e-cbe2-4673-abe4-28fa34d421fb admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:08.869948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53b74b-fabd-467b-9516-9c9fc13051a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:08.870706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53b74b-fabd-467b-9516-9c9fc13051a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.870991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53b74b-fabd-467b-9516-9c9fc13051a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.871268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53b74b-fabd-467b-9516-9c9fc13051a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.872146 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53b74b-fabd-467b-9516-9c9fc13051a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:08.873781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53b74b-fabd-467b-9516-9c9fc13051a5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:08.905171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1236/2482] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:59:08.913124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad627291-bc66-41be-b166-a07681e4e6d8 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:08.924520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad627291-bc66-41be-b166-a07681e4e6d8 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:08.930360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:08.931271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.931558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.931838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] PATH_INFO: `/v3/projects/2c164da911e94878a9b386dbe2bbe455/users/fbf8eb186f29404cb4c66e2b14164824/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.950599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c164da911e94878a9b386dbe2bbe455, user_id=fbf8eb186f29404cb4c66e2b14164824, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:08.954030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:09.136624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1247/2483] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:08 2022] PUT /identity/v3/projects/2c164da911e94878a9b386dbe2bbe455/users/fbf8eb186f29404cb4c66e2b14164824/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:09.151150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e3aa-7863-460a-966d-4bffab0fde3a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:09.151422 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e3aa-7863-460a-966d-4bffab0fde3a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:09.152274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e3aa-7863-460a-966d-4bffab0fde3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:09.188471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b985e3aa-7863-460a-966d-4bffab0fde3a None None] MFA Rules not processed for user `fbf8eb186f29404cb4c66e2b14164824`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:09.190013 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b985e3aa-7863-460a-966d-4bffab0fde3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:09.273302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1237/2484] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:09.283050 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:09.285092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:09.293289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:09.353152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7cd78-9748-47ca-9aae-91ca9f222bce admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:09.358028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:09.358808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:09.359093 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:09.359372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:09.368905 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:09.370807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:09.381846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1248/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:13.328493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ef63-7e47-4d5d-a88f-aadb35d26f89 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:13.329736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ef63-7e47-4d5d-a88f-aadb35d26f89 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:13.330283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ef63-7e47-4d5d-a88f-aadb35d26f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:13.355113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b196ef63-7e47-4d5d-a88f-aadb35d26f89 None None] MFA Rules not processed for user `ffd80d442d404aaa95e88bac7a937ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:13.356395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b196ef63-7e47-4d5d-a88f-aadb35d26f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:13.424995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1238/2486] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:14.092530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:14.094678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:14.110809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785dd40-34d6-49a9-8d34-7affad902e1a service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:14.116161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318c636-d763-4577-8236-3334da1d5acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:14.117038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c636-d763-4577-8236-3334da1d5acd service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:14.117537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c636-d763-4577-8236-3334da1d5acd service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:14.118137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c636-d763-4577-8236-3334da1d5acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:14.120531 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8318c636-d763-4577-8236-3334da1d5acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:14.134262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318c636-d763-4577-8236-3334da1d5acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:14.136453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318c636-d763-4577-8236-3334da1d5acd service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:14.149175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1249/2487] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:23.417504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:24.144623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=30 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:33.347498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ef63-7e47-4d5d-a88f-aadb35d26f89 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:33.426338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ef63-7e47-4d5d-a88f-aadb35d26f89 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:33.432194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:33.433088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:33.433453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:33.433741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] PATH_INFO: `/v3/users/fbf8eb186f29404cb4c66e2b14164824` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:33.435266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf8eb186f29404cb4c66e2b14164824)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:33.437337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:33.671495 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf8eb186f29404cb4c66e2b14164824'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:33.755923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf8eb186f29404cb4c66e2b14164824'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:33.774139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf8eb186f29404cb4c66e2b14164824'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:33.775255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf8eb186f29404cb4c66e2b14164824'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:33.783679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf8eb186f29404cb4c66e2b14164824'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:33.789889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1239/2488] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:33 2022] DELETE /identity/v3/users/fbf8eb186f29404cb4c66e2b14164824 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:33.800934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaef366-bd82-4b5e-b2dd-61313ecbb736 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:33.800934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaef366-bd82-4b5e-b2dd-61313ecbb736 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:33.800934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaef366-bd82-4b5e-b2dd-61313ecbb736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:33.813186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ffaef366-bd82-4b5e-b2dd-61313ecbb736 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:33.814536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ffaef366-bd82-4b5e-b2dd-61313ecbb736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:33.893489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1250/2489] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:59:33.906541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:33.908943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:33.977543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53622-d0cc-4ebe-86e7-e4ed7418b1ef admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:33.983565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e1cc6-86f4-4a06-8e78-4e836b7d9a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:33.983565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1cc6-86f4-4a06-8e78-4e836b7d9a12 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:33.983565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1cc6-86f4-4a06-8e78-4e836b7d9a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:33.983565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1cc6-86f4-4a06-8e78-4e836b7d9a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:34.000426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e1cc6-86f4-4a06-8e78-4e836b7d9a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:34.002025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e1cc6-86f4-4a06-8e78-4e836b7d9a12 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:34.041082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1240/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:59:34.442649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaef366-bd82-4b5e-b2dd-61313ecbb736 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:34.444321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ffaef366-bd82-4b5e-b2dd-61313ecbb736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:34.459935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaef366-bd82-4b5e-b2dd-61313ecbb736 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:34.466558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:34.467766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:34.468265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:34.468727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] PATH_INFO: `/v3/projects/2c164da911e94878a9b386dbe2bbe455` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:34.471025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c164da911e94878a9b386dbe2bbe455)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:34.475568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:34.658032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c164da911e94878a9b386dbe2bbe455', 'request_id': 'req-e905633b-4c26-4ef7-b35e-27715195403e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:34.767356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c164da911e94878a9b386dbe2bbe455', 'request_id': 'req-e905633b-4c26-4ef7-b35e-27715195403e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:34.775669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c164da911e94878a9b386dbe2bbe455', 'request_id': 'req-e905633b-4c26-4ef7-b35e-27715195403e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:34.791515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] The token cache is being invalidate because project 2c164da911e94878a9b386dbe2bbe455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:34.791896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:34.792636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-e905633b-4c26-4ef7-b35e-27715195403e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:34.794871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1251/2491] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:34 2022] DELETE /identity/v3/projects/2c164da911e94878a9b386dbe2bbe455 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:34.799345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e24f-7f07-42e1-a759-a54e33cf31f0 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:34.799928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e24f-7f07-42e1-a759-a54e33cf31f0 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:34.800104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e24f-7f07-42e1-a759-a54e33cf31f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:34.820775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0dc2e24f-7f07-42e1-a759-a54e33cf31f0 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:34.822258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0dc2e24f-7f07-42e1-a759-a54e33cf31f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:34.841691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:34.884970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1241/2492] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:59:34.893475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddee63-ca08-431d-ae32-f06935d4c946 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:34.894400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddee63-ca08-431d-ae32-f06935d4c946 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:34.895530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddee63-ca08-431d-ae32-f06935d4c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:34.916042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-a9ddee63-ca08-431d-ae32-f06935d4c946 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:34.917411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a9ddee63-ca08-431d-ae32-f06935d4c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:34.928746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1252/2493] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:34.931638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e24f-7f07-42e1-a759-a54e33cf31f0 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:34.942513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e24f-7f07-42e1-a759-a54e33cf31f0 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:34.947107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:34.947764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:34.948049 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:34.948343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:34.949118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:59:34.949538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:34.951764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:34.963686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1242/2494] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:59:34.968017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddee63-ca08-431d-ae32-f06935d4c946 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:34.977859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddee63-ca08-431d-ae32-f06935d4c946 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:34.993729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b489d9-5b2b-4ae3-aa22-48c4ae493e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:34.995147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b489d9-5b2b-4ae3-aa22-48c4ae493e5d admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:34.995799 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b489d9-5b2b-4ae3-aa22-48c4ae493e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:34.996764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b489d9-5b2b-4ae3-aa22-48c4ae493e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:34.998902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b489d9-5b2b-4ae3-aa22-48c4ae493e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:35.000971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b489d9-5b2b-4ae3-aa22-48c4ae493e5d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:35.119552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1253/2495] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:34 2022] POST /identity/v3/projects => generated 353 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:35.120474 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:35.134287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4108-68da-4cb3-9216-2a1768362089 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:35.265609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b5405-c7b9-4264-bf69-67bfe835b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:35.266325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b5405-c7b9-4264-bf69-67bfe835b0bb admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:35.266615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b5405-c7b9-4264-bf69-67bfe835b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:35.266893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b5405-c7b9-4264-bf69-67bfe835b0bb admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:35.267595 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b5405-c7b9-4264-bf69-67bfe835b0bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:35.269578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b5405-c7b9-4264-bf69-67bfe835b0bb admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:35.364282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1243/2496] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:35 2022] POST /identity/v3/users => generated 277 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:35.368096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b489d9-5b2b-4ae3-aa22-48c4ae493e5d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:35.396040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b489d9-5b2b-4ae3-aa22-48c4ae493e5d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:35.399361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558fa0-024e-496e-839b-96611f97cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:35.400062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558fa0-024e-496e-839b-96611f97cb86 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:35.400353 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558fa0-024e-496e-839b-96611f97cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:35.400744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558fa0-024e-496e-839b-96611f97cb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:35.401392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69558fa0-024e-496e-839b-96611f97cb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:35.403072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69558fa0-024e-496e-839b-96611f97cb86 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:35.417681 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1254/2497] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:59:35.424191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b5405-c7b9-4264-bf69-67bfe835b0bb admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:35.436612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b5405-c7b9-4264-bf69-67bfe835b0bb admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:35.441678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e841ff-0076-4969-a43a-baac2620686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:35.442391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e841ff-0076-4969-a43a-baac2620686a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:35.444217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e841ff-0076-4969-a43a-baac2620686a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:35.444217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e841ff-0076-4969-a43a-baac2620686a admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:35.444217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e841ff-0076-4969-a43a-baac2620686a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:35.445275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e841ff-0076-4969-a43a-baac2620686a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:35.462633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1244/2498] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:35.463761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558fa0-024e-496e-839b-96611f97cb86 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:35.477516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558fa0-024e-496e-839b-96611f97cb86 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:35.483354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:35.484260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:35.484643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:35.484962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] PATH_INFO: `/v3/projects/172c872d5eeb4c02a36987ded48b5c5a/users/87ff2402e4b742cf89943e6c23ef8732/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:35.505265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172c872d5eeb4c02a36987ded48b5c5a, user_id=87ff2402e4b742cf89943e6c23ef8732, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:35.507985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:35.599910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1255/2499] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:35 2022] PUT /identity/v3/projects/172c872d5eeb4c02a36987ded48b5c5a/users/87ff2402e4b742cf89943e6c23ef8732/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:35.616012 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901803-b18a-47ee-854b-c94b5c062f1e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:35.616334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901803-b18a-47ee-854b-c94b5c062f1e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:35.616618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901803-b18a-47ee-854b-c94b5c062f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:35.659326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c8901803-b18a-47ee-854b-c94b5c062f1e None None] MFA Rules not processed for user `87ff2402e4b742cf89943e6c23ef8732`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:35.662035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c8901803-b18a-47ee-854b-c94b5c062f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:35.740814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1245/2500] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:35 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:35.765127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:35.767548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:35.799774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:35.843523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75508a87-d05f-4bd2-9ceb-eccb9f207115 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:35.848842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032b57a-a8f0-4070-a07f-001014e3c24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:35.853421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b57a-a8f0-4070-a07f-001014e3c24e service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:35.853421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b57a-a8f0-4070-a07f-001014e3c24e service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:35.853421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b57a-a8f0-4070-a07f-001014e3c24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:35.861711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032b57a-a8f0-4070-a07f-001014e3c24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:35.863338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032b57a-a8f0-4070-a07f-001014e3c24e service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:35.874521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1256/2501] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:35 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:39.703341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8901803-b18a-47ee-854b-c94b5c062f1e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:39.733234 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:39.808276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8901803-b18a-47ee-854b-c94b5c062f1e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:39.820752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:39.821785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:39.822214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:39.822688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] PATH_INFO: `/v3/users/87ff2402e4b742cf89943e6c23ef8732` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:39.824419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ff2402e4b742cf89943e6c23ef8732)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:39.828140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:40.077171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ff2402e4b742cf89943e6c23ef8732'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:40.132952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ff2402e4b742cf89943e6c23ef8732'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:40.147113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ff2402e4b742cf89943e6c23ef8732'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:40.147836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ff2402e4b742cf89943e6c23ef8732'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:40.155584 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ff2402e4b742cf89943e6c23ef8732'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:40.161836 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1246/2502] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:39 2022] DELETE /identity/v3/users/87ff2402e4b742cf89943e6c23ef8732 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:40.166708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe072a-729e-4afa-aebe-d2c7da15329c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:40.167250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe072a-729e-4afa-aebe-d2c7da15329c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:40.167250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe072a-729e-4afa-aebe-d2c7da15329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:40.185701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-14fe072a-729e-4afa-aebe-d2c7da15329c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:40.187105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-14fe072a-729e-4afa-aebe-d2c7da15329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:40.317883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1257/2503] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:40.331668 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:40.333656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:40.431568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdce26-ba8b-4fbe-bf9b-de2f9e5bc77a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:40.438420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ede6d-6aed-4f6b-a919-cb1d3f7c570a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:40.439103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ede6d-6aed-4f6b-a919-cb1d3f7c570a service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:40.439383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ede6d-6aed-4f6b-a919-cb1d3f7c570a service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:40.439665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ede6d-6aed-4f6b-a919-cb1d3f7c570a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:40.471760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ede6d-6aed-4f6b-a919-cb1d3f7c570a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:40.473596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ede6d-6aed-4f6b-a919-cb1d3f7c570a service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:40.488741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1247/2504] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:40.881408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe072a-729e-4afa-aebe-d2c7da15329c None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:40.883639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-14fe072a-729e-4afa-aebe-d2c7da15329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:40.897943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe072a-729e-4afa-aebe-d2c7da15329c None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:40.909080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:40.910083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:40.910473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:40.910814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] PATH_INFO: `/v3/projects/172c872d5eeb4c02a36987ded48b5c5a` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:40.914676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=172c872d5eeb4c02a36987ded48b5c5a)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:40.916632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:41.054020 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172c872d5eeb4c02a36987ded48b5c5a', 'request_id': 'req-8f7a3d67-ea93-4c19-a635-f203c2021aaf'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:41.139223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172c872d5eeb4c02a36987ded48b5c5a', 'request_id': 'req-8f7a3d67-ea93-4c19-a635-f203c2021aaf'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:41.147214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172c872d5eeb4c02a36987ded48b5c5a', 'request_id': 'req-8f7a3d67-ea93-4c19-a635-f203c2021aaf'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:41.164154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] The token cache is being invalidate because project 172c872d5eeb4c02a36987ded48b5c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:41.164154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:41.164845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f7a3d67-ea93-4c19-a635-f203c2021aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:41.167119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1258/2505] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:40 2022] DELETE /identity/v3/projects/172c872d5eeb4c02a36987ded48b5c5a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:41.173240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816704-cb7e-4579-bb17-f6de3988f03b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.173780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816704-cb7e-4579-bb17-f6de3988f03b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.181215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816704-cb7e-4579-bb17-f6de3988f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.196303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-10816704-cb7e-4579-bb17-f6de3988f03b None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:41.197698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-10816704-cb7e-4579-bb17-f6de3988f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:41.239924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:41.289860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1248/2506] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:41.297481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72614acf-73ab-4803-9914-2170eb7cc4fb None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.303755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72614acf-73ab-4803-9914-2170eb7cc4fb None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.303755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72614acf-73ab-4803-9914-2170eb7cc4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.328439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-72614acf-73ab-4803-9914-2170eb7cc4fb None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:41.329892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-72614acf-73ab-4803-9914-2170eb7cc4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:41.342320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1259/2507] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:41.344680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10816704-cb7e-4579-bb17-f6de3988f03b None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:41.355968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10816704-cb7e-4579-bb17-f6de3988f03b None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:41.361190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:41.362078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.362392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.362669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.363463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:59:41.363911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:41.365523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:41.381450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1249/2508] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 14:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:59:41.382828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72614acf-73ab-4803-9914-2170eb7cc4fb None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:41.396950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72614acf-73ab-4803-9914-2170eb7cc4fb None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:41.403005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feec99-9121-402b-864a-74b9dca6588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:41.404532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feec99-9121-402b-864a-74b9dca6588c admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.404993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feec99-9121-402b-864a-74b9dca6588c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.405274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feec99-9121-402b-864a-74b9dca6588c admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.406208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feec99-9121-402b-864a-74b9dca6588c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:41.408302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feec99-9121-402b-864a-74b9dca6588c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:41.490015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1260/2509] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:41 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:41.495895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:41.507351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd37106-ee6c-4e96-b553-499bcec96da6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:41.577456 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea0a11-fb59-4ef5-abae-acea743ee879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:41.578177 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea0a11-fb59-4ef5-abae-acea743ee879 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.578582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea0a11-fb59-4ef5-abae-acea743ee879 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.578869 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea0a11-fb59-4ef5-abae-acea743ee879 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.579573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea0a11-fb59-4ef5-abae-acea743ee879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:41.581548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea0a11-fb59-4ef5-abae-acea743ee879 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:41.643690 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1250/2510] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:41 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:41.647957 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feec99-9121-402b-864a-74b9dca6588c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:41.662804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feec99-9121-402b-864a-74b9dca6588c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:41.674366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d3279-0236-4fe8-8c52-2bf2ae846149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:41.674366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d3279-0236-4fe8-8c52-2bf2ae846149 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.674366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d3279-0236-4fe8-8c52-2bf2ae846149 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.674366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d3279-0236-4fe8-8c52-2bf2ae846149 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.674819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d3279-0236-4fe8-8c52-2bf2ae846149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:41.674819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d3279-0236-4fe8-8c52-2bf2ae846149 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:41.686928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1261/2511] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:59:41.691279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea0a11-fb59-4ef5-abae-acea743ee879 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:41.703488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea0a11-fb59-4ef5-abae-acea743ee879 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:41.708600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee229cb-d533-4711-ab2e-d0da167568d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:41.709284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee229cb-d533-4711-ab2e-d0da167568d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.709576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee229cb-d533-4711-ab2e-d0da167568d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.709855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee229cb-d533-4711-ab2e-d0da167568d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.710633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee229cb-d533-4711-ab2e-d0da167568d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:41.712295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee229cb-d533-4711-ab2e-d0da167568d6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:41.723442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1251/2512] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:41.727677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d3279-0236-4fe8-8c52-2bf2ae846149 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:41.743539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d3279-0236-4fe8-8c52-2bf2ae846149 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:41.743838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:41.745270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.745457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.745720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] PATH_INFO: `/v3/projects/041027a9962a4e3398d77541066ceffa/users/12f911a2bafc4d978289551b7d7dc283/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.750788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:41.765002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=041027a9962a4e3398d77541066ceffa, user_id=12f911a2bafc4d978289551b7d7dc283, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:41.767825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:41.832154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1262/2513] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:41 2022] PUT /identity/v3/projects/041027a9962a4e3398d77541066ceffa/users/12f911a2bafc4d978289551b7d7dc283/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:41.843217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a20e9-9672-4222-bfc4-97faa86dfdcf None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.843513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a20e9-9672-4222-bfc4-97faa86dfdcf None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.843797 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a20e9-9672-4222-bfc4-97faa86dfdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.849289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:41.862462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:41.906476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-938a20e9-9672-4222-bfc4-97faa86dfdcf None None] MFA Rules not processed for user `12f911a2bafc4d978289551b7d7dc283`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:41.907623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-938a20e9-9672-4222-bfc4-97faa86dfdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:41.976439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766b9dd-3577-49fe-9bf3-67cf285fe6aa admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:41.981433 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:41.982621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:41.983014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:41.983915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:41.989239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:42.024035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1252/2514] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:42.028978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a20e9-9672-4222-bfc4-97faa86dfdcf None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:42.083357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:42.084812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:42.088326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:42.096618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1263/2515] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:42.118449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a20e9-9672-4222-bfc4-97faa86dfdcf None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:42.127149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c6b39-7318-4405-913c-57b16bbec44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:42.127837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c6b39-7318-4405-913c-57b16bbec44d admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:42.128553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c6b39-7318-4405-913c-57b16bbec44d admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:42.128859 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c6b39-7318-4405-913c-57b16bbec44d admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:42.129712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c6b39-7318-4405-913c-57b16bbec44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:42.131733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c6b39-7318-4405-913c-57b16bbec44d admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:42.256394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1253/2516] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:42 2022] POST /identity/v3/projects => generated 391 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:42.260470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:42.271706 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd385a7d-cad1-41ba-a200-1e802dcf1259 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:42.389857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5522089-ef3f-4c03-9f26-59dd5864ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:42.389857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5522089-ef3f-4c03-9f26-59dd5864ba44 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:42.389857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5522089-ef3f-4c03-9f26-59dd5864ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:42.390532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5522089-ef3f-4c03-9f26-59dd5864ba44 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:42.391454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5522089-ef3f-4c03-9f26-59dd5864ba44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:42.393908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5522089-ef3f-4c03-9f26-59dd5864ba44 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:42.503036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1264/2517] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:42 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:42.507461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c6b39-7318-4405-913c-57b16bbec44d admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:42.522509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c6b39-7318-4405-913c-57b16bbec44d admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:42.534165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e9f8b-fa3e-4a2e-9532-ab434c4565c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:42.535128 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e9f8b-fa3e-4a2e-9532-ab434c4565c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:42.536310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e9f8b-fa3e-4a2e-9532-ab434c4565c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:42.536546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e9f8b-fa3e-4a2e-9532-ab434c4565c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:42.538339 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e9f8b-fa3e-4a2e-9532-ab434c4565c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:42.542886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e9f8b-fa3e-4a2e-9532-ab434c4565c5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:42.560683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1254/2518] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:59:42.564078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5522089-ef3f-4c03-9f26-59dd5864ba44 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:42.581108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5522089-ef3f-4c03-9f26-59dd5864ba44 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:42.588460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8d8ff-ab37-4852-bee8-d50b24a514d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:42.589602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d8ff-ab37-4852-bee8-d50b24a514d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:42.590068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d8ff-ab37-4852-bee8-d50b24a514d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:42.590592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d8ff-ab37-4852-bee8-d50b24a514d9 admin admin] PATH_INFO: `/v3/projects/c7e13c81988e41d29f10c6452ab129d4/users/3e5b54ec288f4f8da8c5f726936834dc/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:42.611030 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d8ff-ab37-4852-bee8-d50b24a514d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e13c81988e41d29f10c6452ab129d4, user_id=3e5b54ec288f4f8da8c5f726936834dc, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:42.615334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d8ff-ab37-4852-bee8-d50b24a514d9 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:42.707446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:42.717162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1265/2519] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:42 2022] PUT /identity/v3/projects/c7e13c81988e41d29f10c6452ab129d4/users/3e5b54ec288f4f8da8c5f726936834dc/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:59:42.725346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e9f8b-fa3e-4a2e-9532-ab434c4565c5 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:42.760883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e9f8b-fa3e-4a2e-9532-ab434c4565c5 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:42.857017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8a454-d7e2-425f-934f-90b3a755426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:42.858067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a454-d7e2-425f-934f-90b3a755426a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:42.858251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a454-d7e2-425f-934f-90b3a755426a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:42.858991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a454-d7e2-425f-934f-90b3a755426a admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:42.859214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8a454-d7e2-425f-934f-90b3a755426a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:42.860876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8a454-d7e2-425f-934f-90b3a755426a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:42.877402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1255/2520] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:59:42.879072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8d8ff-ab37-4852-bee8-d50b24a514d9 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:42.891309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8d8ff-ab37-4852-bee8-d50b24a514d9 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:42.899320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:42.905872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:42.905872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:42.905872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] PATH_INFO: `/v3/projects/c7e13c81988e41d29f10c6452ab129d4/users/3e5b54ec288f4f8da8c5f726936834dc/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:42.905872 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e13c81988e41d29f10c6452ab129d4, user_id=3e5b54ec288f4f8da8c5f726936834dc, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:42.907731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:42.935787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1266/2521] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:42 2022] PUT /identity/v3/projects/c7e13c81988e41d29f10c6452ab129d4/users/3e5b54ec288f4f8da8c5f726936834dc/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:42.951111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22dff-dfea-40c5-8917-f8cbe3560096 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:42.951724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22dff-dfea-40c5-8917-f8cbe3560096 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:42.952622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22dff-dfea-40c5-8917-f8cbe3560096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:43.003847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-95c22dff-dfea-40c5-8917-f8cbe3560096 None None] MFA Rules not processed for user `3e5b54ec288f4f8da8c5f726936834dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:43.006340 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-95c22dff-dfea-40c5-8917-f8cbe3560096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:43.096286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1256/2522] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:43.113771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:43.115780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:43.259600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da3224-d230-4cb2-83bf-6cebb116ab63 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:43.267336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0754a-984e-4634-af1f-b8f007504121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:43.269668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0754a-984e-4634-af1f-b8f007504121 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:43.270219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0754a-984e-4634-af1f-b8f007504121 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:43.270780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0754a-984e-4634-af1f-b8f007504121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:43.356095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0754a-984e-4634-af1f-b8f007504121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:43.358377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0754a-984e-4634-af1f-b8f007504121 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:43.370818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1267/2523] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:50.494902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c22dff-dfea-40c5-8917-f8cbe3560096 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:50.497803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-95c22dff-dfea-40c5-8917-f8cbe3560096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:50.547200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:50.589507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c22dff-dfea-40c5-8917-f8cbe3560096 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:50.593838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:50.594543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:50.594814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:50.595139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:50.607239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:50.609498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:50.622699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1257/2524] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:53.365912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:56.361953 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c329fa-0f58-4bf2-ad96-8327ee524b7d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:56.362534 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c329fa-0f58-4bf2-ad96-8327ee524b7d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:56.362952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c329fa-0f58-4bf2-ad96-8327ee524b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:56.391456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-34c329fa-0f58-4bf2-ad96-8327ee524b7d None None] MFA Rules not processed for user `12f911a2bafc4d978289551b7d7dc283`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:56.393671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-34c329fa-0f58-4bf2-ad96-8327ee524b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:56.402673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1268/2525] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:00.670520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=12 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:06.377970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:08.306383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:08.308691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:08.464059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d809fc-2a2c-4ddf-a1b2-bbe32d0e84dc service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:08.469156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:08.470048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:08.470411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:08.470950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] PATH_INFO: `/v3/users/12e6b6ec3cbb47d791b9d93cc5b61898` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:08.472048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e6b6ec3cbb47d791b9d93cc5b61898)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:08.474052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:08.871199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e6b6ec3cbb47d791b9d93cc5b61898'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:08.955875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e6b6ec3cbb47d791b9d93cc5b61898'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:08.976258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e6b6ec3cbb47d791b9d93cc5b61898'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:08.977155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e6b6ec3cbb47d791b9d93cc5b61898'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:08.992247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e6b6ec3cbb47d791b9d93cc5b61898'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:09.003948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1258/2526] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:00:08 2022] DELETE /identity/v3/users/12e6b6ec3cbb47d791b9d93cc5b61898 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:00:09.010078 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6143e1-80c7-4bfc-a6e2-ec2bc9ae5d85 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:09.010914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6143e1-80c7-4bfc-a6e2-ec2bc9ae5d85 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:09.010914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6143e1-80c7-4bfc-a6e2-ec2bc9ae5d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:09.032940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5f6143e1-80c7-4bfc-a6e2-ec2bc9ae5d85 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:09.034315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5f6143e1-80c7-4bfc-a6e2-ec2bc9ae5d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:09.115772 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1269/2527] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:09.128902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:09.130511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:09.203980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7241410-4a69-4ece-b396-3cb6bbefcecc admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:09.215388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6eec-fa4b-4d97-83f4-f978e5b0d4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:09.215388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6eec-fa4b-4d97-83f4-f978e5b0d4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:09.215388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6eec-fa4b-4d97-83f4-f978e5b0d4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:09.215388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6eec-fa4b-4d97-83f4-f978e5b0d4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:09.221354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec6eec-fa4b-4d97-83f4-f978e5b0d4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:09.223346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec6eec-fa4b-4d97-83f4-f978e5b0d4f1 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:09.235342 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1259/2528] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:00:09.517666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6143e1-80c7-4bfc-a6e2-ec2bc9ae5d85 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:09.519238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5f6143e1-80c7-4bfc-a6e2-ec2bc9ae5d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:09.535870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6143e1-80c7-4bfc-a6e2-ec2bc9ae5d85 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:09.537731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:09.538823 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:09.539474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:09.539850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] PATH_INFO: `/v3/projects/71ace975200e4f7ab813e2fea2f07298` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:09.541629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ace975200e4f7ab813e2fea2f07298)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:09.544593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:09.687879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ace975200e4f7ab813e2fea2f07298', 'request_id': 'req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:09.812346 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ace975200e4f7ab813e2fea2f07298', 'request_id': 'req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:09.819406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ace975200e4f7ab813e2fea2f07298', 'request_id': 'req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:09.831407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] The token cache is being invalidate because project 71ace975200e4f7ab813e2fea2f07298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:00:09.832094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:09.832762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:09.835041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1270/2529] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:00:09 2022] DELETE /identity/v3/projects/71ace975200e4f7ab813e2fea2f07298 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:00:10.796874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924060-6910-4252-9dcc-76a73bae91a1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:10.797421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924060-6910-4252-9dcc-76a73bae91a1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:10.797603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924060-6910-4252-9dcc-76a73bae91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:10.817895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ad924060-6910-4252-9dcc-76a73bae91a1 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:10.819463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ad924060-6910-4252-9dcc-76a73bae91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:10.837954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:10.877629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1260/2530] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:19.828219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:21.395079 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=15 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:52.745654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:52.747166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:52.843654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574e9a5-d9bf-4534-a7a5-ced0ac7a0b0b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:52.848985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:52.849750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:52.850042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:52.850360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:52.852151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:52.864630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:52.866357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:52.877800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1271/2531] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:00:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:02.872775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=41 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:16.885317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a38df-7c61-4336-a922-e88a03c27c05 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:16.885818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a38df-7c61-4336-a922-e88a03c27c05 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:16.885945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a38df-7c61-4336-a922-e88a03c27c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:16.909692 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d55a38df-7c61-4336-a922-e88a03c27c05 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:16.911019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d55a38df-7c61-4336-a922-e88a03c27c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:16.918200 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1261/2532] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:26.900111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:57.131069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:57.132566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:57.198250 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05811f4-0e74-4cb2-9b83-7e3daf467589 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:57.202671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:57.203532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:57.203816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:57.204094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] PATH_INFO: `/v3/users/12f911a2bafc4d978289551b7d7dc283` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:57.205265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f911a2bafc4d978289551b7d7dc283)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:57.207202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:57.373255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f911a2bafc4d978289551b7d7dc283'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:57.432376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f911a2bafc4d978289551b7d7dc283'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:57.445143 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f911a2bafc4d978289551b7d7dc283'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:57.452247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f911a2bafc4d978289551b7d7dc283'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:57.452946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f911a2bafc4d978289551b7d7dc283'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:57.458906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1272/2533] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:01:57 2022] DELETE /identity/v3/users/12f911a2bafc4d978289551b7d7dc283 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:01:57.463990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710185-4e18-4466-b587-3a36e40fc9f3 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:57.464488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710185-4e18-4466-b587-3a36e40fc9f3 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:57.464606 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710185-4e18-4466-b587-3a36e40fc9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:57.482179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-81710185-4e18-4466-b587-3a36e40fc9f3 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:57.483369 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-81710185-4e18-4466-b587-3a36e40fc9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:57.542759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1262/2534] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:57.552457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:57.553887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:57.611075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046f7a-5c1c-40b2-bbb4-225d3c99815e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:57.614793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a060ed-96fe-4b3b-8f5b-51efc2d43e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:57.615448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a060ed-96fe-4b3b-8f5b-51efc2d43e43 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:57.615739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a060ed-96fe-4b3b-8f5b-51efc2d43e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:57.616022 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a060ed-96fe-4b3b-8f5b-51efc2d43e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:57.626652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a060ed-96fe-4b3b-8f5b-51efc2d43e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:57.627071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a060ed-96fe-4b3b-8f5b-51efc2d43e43 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:57.636696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1273/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:57.893331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710185-4e18-4466-b587-3a36e40fc9f3 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:57.894852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-81710185-4e18-4466-b587-3a36e40fc9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:57.908572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710185-4e18-4466-b587-3a36e40fc9f3 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:57.914082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:57.914970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:57.915315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:57.915506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] PATH_INFO: `/v3/projects/041027a9962a4e3398d77541066ceffa` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:57.916889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041027a9962a4e3398d77541066ceffa)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:57.918686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:58.004214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041027a9962a4e3398d77541066ceffa', 'request_id': 'req-a1208db8-35b9-4c57-90ae-f2c7da6c2789'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.043538 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041027a9962a4e3398d77541066ceffa', 'request_id': 'req-a1208db8-35b9-4c57-90ae-f2c7da6c2789'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.049132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041027a9962a4e3398d77541066ceffa', 'request_id': 'req-a1208db8-35b9-4c57-90ae-f2c7da6c2789'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.060318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] The token cache is being invalidate because project 041027a9962a4e3398d77541066ceffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:01:58.060607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.061302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.062891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1263/2536] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:01:57 2022] DELETE /identity/v3/projects/041027a9962a4e3398d77541066ceffa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:58.067031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a060ed-96fe-4b3b-8f5b-51efc2d43e43 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:58.077275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a060ed-96fe-4b3b-8f5b-51efc2d43e43 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:58.095841 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:58.134171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:58.135105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:58.135339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:58.135618 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] PATH_INFO: `/v3/users/3e5b54ec288f4f8da8c5f726936834dc` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:58.136865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5b54ec288f4f8da8c5f726936834dc)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:58.138836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:58.303223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5b54ec288f4f8da8c5f726936834dc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.392416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5b54ec288f4f8da8c5f726936834dc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.405266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5b54ec288f4f8da8c5f726936834dc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.412327 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5b54ec288f4f8da8c5f726936834dc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.412987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-7cba0f89-4da6-4c80-8b86-8b38392bfc16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5b54ec288f4f8da8c5f726936834dc'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:58.419183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1274/2537] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:01:58 2022] DELETE /identity/v3/users/3e5b54ec288f4f8da8c5f726936834dc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:58.872843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:58.874384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:58.889647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208db8-35b9-4c57-90ae-f2c7da6c2789 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:58.949542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:58.950366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:58.950649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:58.950924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] PATH_INFO: `/v3/projects/c7e13c81988e41d29f10c6452ab129d4` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:58.952089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e13c81988e41d29f10c6452ab129d4)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:58.953998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:59.034039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:59.050878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e13c81988e41d29f10c6452ab129d4', 'request_id': 'req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:59.163890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e13c81988e41d29f10c6452ab129d4', 'request_id': 'req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:59.170059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e13c81988e41d29f10c6452ab129d4', 'request_id': 'req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:59.181819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] The token cache is being invalidate because project c7e13c81988e41d29f10c6452ab129d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:01:59.182129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:59.182784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:59.184341 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1264/2538] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:01:58 2022] DELETE /identity/v3/projects/c7e13c81988e41d29f10c6452ab129d4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:08.415641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:09.243830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:13.217904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552bd7-568e-419d-a54c-b52ae7fca17b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:13.218452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552bd7-568e-419d-a54c-b52ae7fca17b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:13.218591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552bd7-568e-419d-a54c-b52ae7fca17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:13.236431 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-9f552bd7-568e-419d-a54c-b52ae7fca17b None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:13.237628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9f552bd7-568e-419d-a54c-b52ae7fca17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:13.300754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1275/2539] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:02:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:13.310086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:13.311754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:13.376397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a6f9-0eb9-4b15-a70b-d6aaf62dc9d3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:13.380078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:13.380798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:13.381078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:13.381444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:13.383303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:13.477167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:13.478650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:13.500582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1265/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:15.135642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f552bd7-568e-419d-a54c-b52ae7fca17b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:15.138036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9f552bd7-568e-419d-a54c-b52ae7fca17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:15.157163 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f552bd7-568e-419d-a54c-b52ae7fca17b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:15.163032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ee897-415d-4af7-8281-69a52b5cf1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:15.163890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ee897-415d-4af7-8281-69a52b5cf1ae service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:15.164298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ee897-415d-4af7-8281-69a52b5cf1ae service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:15.164593 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ee897-415d-4af7-8281-69a52b5cf1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:15.166670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e73ee897-415d-4af7-8281-69a52b5cf1ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:15.184761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ee897-415d-4af7-8281-69a52b5cf1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:15.187719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ee897-415d-4af7-8281-69a52b5cf1ae service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:15.210674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1276/2541] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:15.818780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:15.820378 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:15.832972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302845-e392-4474-af77-ec8353f16961 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:15.837284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:15.848159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:15.848159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:15.848159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:15.848159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:15.856907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:15.858412 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:15.872909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1266/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:20.530678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b424bb-1773-4174-be6c-fcf8091f80a9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:20.534074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b424bb-1773-4174-be6c-fcf8091f80a9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:20.534074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b424bb-1773-4174-be6c-fcf8091f80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:20.549800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-79b424bb-1773-4174-be6c-fcf8091f80a9 None None] MFA Rules not processed for user `ffd80d442d404aaa95e88bac7a937ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:20.551034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-79b424bb-1773-4174-be6c-fcf8091f80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:20.605950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1277/2543] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:25.867362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=72 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:26.746319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:26.756113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281b722-e1bf-424a-8093-2f11ff2169c7 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:26.759915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:26.760632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:26.760980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:26.761316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:26.763134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:26.829335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:26.830816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:26.840884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1267/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:30.599198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=56 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:36.836347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=30 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:39.784692 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b424bb-1773-4174-be6c-fcf8091f80a9 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:39.794476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b424bb-1773-4174-be6c-fcf8091f80a9 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:39.799021 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:39.799764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:39.800079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:39.800364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:39.802197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:39.812125 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:39.813650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:39.821998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1278/2545] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:49.818747 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:04.260364 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:04.262006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:04.279763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71e0d-1c05-40e2-a950-b05c06733d0c service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:04.298535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f434aed-6d94-4d4d-b1dc-f4927ec72a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:04.298535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f434aed-6d94-4d4d-b1dc-f4927ec72a68 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:04.298535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f434aed-6d94-4d4d-b1dc-f4927ec72a68 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:04.298535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f434aed-6d94-4d4d-b1dc-f4927ec72a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:04.299220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1f434aed-6d94-4d4d-b1dc-f4927ec72a68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:04.303980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f434aed-6d94-4d4d-b1dc-f4927ec72a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:04.305650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f434aed-6d94-4d4d-b1dc-f4927ec72a68 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:04.318087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1268/2546] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:14.313649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:16.193045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:16.194664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:16.274134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb8c18-532c-4a55-af7e-a8ec759a1acb service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:16.279344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:16.280122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:16.280432 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:16.280715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:16.282572 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:16.295267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:16.296860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:16.307853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1279/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:26.302896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=32 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:26.777176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5609bc-d01d-4ab9-8c24-a82d40318506 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:26.777883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5609bc-d01d-4ab9-8c24-a82d40318506 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:26.777883 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5609bc-d01d-4ab9-8c24-a82d40318506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:26.796777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-bf5609bc-d01d-4ab9-8c24-a82d40318506 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:26.801388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bf5609bc-d01d-4ab9-8c24-a82d40318506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:26.805091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1269/2548] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:03:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:26.991495 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:27.005571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8366a-fcf5-4ae7-be4b-22244de42934 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:27.009300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa652e-734d-4211-9e21-e8a8d006d76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:27.009958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa652e-734d-4211-9e21-e8a8d006d76f service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:27.010305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa652e-734d-4211-9e21-e8a8d006d76f service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:27.010762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa652e-734d-4211-9e21-e8a8d006d76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:27.012424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-59aa652e-734d-4211-9e21-e8a8d006d76f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:27.022952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa652e-734d-4211-9e21-e8a8d006d76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:27.024377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa652e-734d-4211-9e21-e8a8d006d76f service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:27.033082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1280/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:03:27.542246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0fd07-a1ff-42ac-9d0a-1fd85c89216f None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:27.542541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0fd07-a1ff-42ac-9d0a-1fd85c89216f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:27.542825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0fd07-a1ff-42ac-9d0a-1fd85c89216f None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:27.544492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1270/2550] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:03:27.550260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5187-b3f9-492c-9a1f-815f9a2b3784 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:27.550753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5187-b3f9-492c-9a1f-815f9a2b3784 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:27.550860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5187-b3f9-492c-9a1f-815f9a2b3784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:27.605861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-89fb5187-b3f9-492c-9a1f-815f9a2b3784 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:27.607172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-89fb5187-b3f9-492c-9a1f-815f9a2b3784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:27.617359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1281/2551] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:03:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:27.628478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0fd07-a1ff-42ac-9d0a-1fd85c89216f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:27.640061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0fd07-a1ff-42ac-9d0a-1fd85c89216f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:27.643572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b3b4d-8395-4f4d-ae5f-aa2cf205c035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:27.644208 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3b4d-8395-4f4d-ae5f-aa2cf205c035 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:27.644491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3b4d-8395-4f4d-ae5f-aa2cf205c035 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:27.644766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3b4d-8395-4f4d-ae5f-aa2cf205c035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:27.655908 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b3b4d-8395-4f4d-ae5f-aa2cf205c035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:27.657336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b3b4d-8395-4f4d-ae5f-aa2cf205c035 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:27.668264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1271/2552] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:27.730629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5187-b3f9-492c-9a1f-815f9a2b3784 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:27.742373 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5187-b3f9-492c-9a1f-815f9a2b3784 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:27.748049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:27.748701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:27.748988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:27.749765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:27.751155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:27.763940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:27.765503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:27.775876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1282/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:35.682781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b3b4d-8395-4f4d-ae5f-aa2cf205c035 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:35.694823 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b3b4d-8395-4f4d-ae5f-aa2cf205c035 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:35.701096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b63a6-3b1e-48db-bba4-06276df63f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:35.701736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b63a6-3b1e-48db-bba4-06276df63f9f service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:35.702021 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b63a6-3b1e-48db-bba4-06276df63f9f service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:35.702333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b63a6-3b1e-48db-bba4-06276df63f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:35.704129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bc5b63a6-3b1e-48db-bba4-06276df63f9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:35.716214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b63a6-3b1e-48db-bba4-06276df63f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:35.717781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b63a6-3b1e-48db-bba4-06276df63f9f service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:35.728495 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1272/2554] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:37.771189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=25 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:40.318832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:40.332960 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2371c-80ab-47b3-bae5-2e5c8f57c1f3 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:40.338560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5f501-a08e-49b0-b396-31ee02a621af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:40.339217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5f501-a08e-49b0-b396-31ee02a621af service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:40.339500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5f501-a08e-49b0-b396-31ee02a621af service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:40.339781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5f501-a08e-49b0-b396-31ee02a621af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:40.341613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3ca5f501-a08e-49b0-b396-31ee02a621af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:40.354232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5f501-a08e-49b0-b396-31ee02a621af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:40.355827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5f501-a08e-49b0-b396-31ee02a621af service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:40.367492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1283/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:45.724124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=15 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:46.908482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7c66a-9bc7-423f-a304-98baeec8a617 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:46.909259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7c66a-9bc7-423f-a304-98baeec8a617 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:46.909259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7c66a-9bc7-423f-a304-98baeec8a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:46.927530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-63a7c66a-9bc7-423f-a304-98baeec8a617 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:46.928746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-63a7c66a-9bc7-423f-a304-98baeec8a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:46.935953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1273/2556] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:47.641789 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102068-47d4-47e2-853b-928bb44ded6e None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:47.642351 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102068-47d4-47e2-853b-928bb44ded6e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:47.642456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102068-47d4-47e2-853b-928bb44ded6e None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:47.643794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1284/2557] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:03:47.649362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13484008-7eb4-44ac-a66d-3b084ee1f5c2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:47.649657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13484008-7eb4-44ac-a66d-3b084ee1f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:47.649937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13484008-7eb4-44ac-a66d-3b084ee1f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:47.668698 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-13484008-7eb4-44ac-a66d-3b084ee1f5c2 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:47.669850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-13484008-7eb4-44ac-a66d-3b084ee1f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:47.681574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1274/2558] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:47.692340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102068-47d4-47e2-853b-928bb44ded6e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:47.703630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102068-47d4-47e2-853b-928bb44ded6e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:47.707217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5440a-21f8-4841-8a68-e92059eccc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:47.707851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5440a-21f8-4841-8a68-e92059eccc1e service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:47.708135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5440a-21f8-4841-8a68-e92059eccc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:47.708413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5440a-21f8-4841-8a68-e92059eccc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:47.719310 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5440a-21f8-4841-8a68-e92059eccc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:47.720729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5440a-21f8-4841-8a68-e92059eccc1e service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:47.731454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1285/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:57.663458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:57.726863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=12 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:07.815243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13484008-7eb4-44ac-a66d-3b084ee1f5c2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:07.827961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13484008-7eb4-44ac-a66d-3b084ee1f5c2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:07.833110 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:07.833784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:07.834068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:07.834380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:07.836469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:07.848771 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:07.850331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:07.861887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1275/2560] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:17.465901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bacde-091f-41c1-894d-e1953530af28 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.466543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bacde-091f-41c1-894d-e1953530af28 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.466543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bacde-091f-41c1-894d-e1953530af28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.486312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-855bacde-091f-41c1-894d-e1953530af28 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:17.487603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-855bacde-091f-41c1-894d-e1953530af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:17.494907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1286/2561] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:17.819655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.829441 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d4011-86fc-471c-9b1a-f5165b88b0cd service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:17.836156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377d0e7-4631-4e15-8126-ef377177dbc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:17.836156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d0e7-4631-4e15-8126-ef377177dbc3 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.836156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d0e7-4631-4e15-8126-ef377177dbc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.836156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d0e7-4631-4e15-8126-ef377177dbc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.836573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7377d0e7-4631-4e15-8126-ef377177dbc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:17.846851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377d0e7-4631-4e15-8126-ef377177dbc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:17.848389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377d0e7-4631-4e15-8126-ef377177dbc3 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:17.856934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1276/2562] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:27.481478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:27.853042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=12 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:47.912218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bacde-091f-41c1-894d-e1953530af28 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:47.913759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-855bacde-091f-41c1-894d-e1953530af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:47.993457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bacde-091f-41c1-894d-e1953530af28 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:47.997113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cc164-9965-466d-8938-7476697dee9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a80e224da849e19538182793f13e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:47.997697 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc164-9965-466d-8938-7476697dee9f service cinder] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:47.997980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc164-9965-466d-8938-7476697dee9f service cinder] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:47.998294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc164-9965-466d-8938-7476697dee9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:48.000074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-451cc164-9965-466d-8938-7476697dee9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:48.012410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cc164-9965-466d-8938-7476697dee9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:48.013838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cc164-9965-466d-8938-7476697dee9f service cinder] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:48.023253 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1287/2563] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:04:58.018891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=35 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:11.336238 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19389a-0d9d-4586-98ac-cc2d35954dbe None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:11.336841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19389a-0d9d-4586-98ac-cc2d35954dbe None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:11.336841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19389a-0d9d-4586-98ac-cc2d35954dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:11.355458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-8c19389a-0d9d-4586-98ac-cc2d35954dbe None None] MFA Rules not processed for user `ffd80d442d404aaa95e88bac7a937ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:11.356732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-8c19389a-0d9d-4586-98ac-cc2d35954dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:11.364616 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1277/2564] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:05:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:21.350421 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:30.243175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb1ab-2e7f-4f72-aff5-d9072e10714a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:30.249695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb1ab-2e7f-4f72-aff5-d9072e10714a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:30.249695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb1ab-2e7f-4f72-aff5-d9072e10714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:30.267521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e6adb1ab-2e7f-4f72-aff5-d9072e10714a None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:30.272661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e6adb1ab-2e7f-4f72-aff5-d9072e10714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:30.276775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1288/2565] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:05:36.173302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19389a-0d9d-4586-98ac-cc2d35954dbe None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:36.184383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19389a-0d9d-4586-98ac-cc2d35954dbe None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:36.188396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:36.189743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:36.190294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:36.190635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:36.192697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:36.275262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:36.275262 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:36.287000 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1278/2566] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:40.258396 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:46.281181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=30 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:15.152945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb1ab-2e7f-4f72-aff5-d9072e10714a None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:15.154410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e6adb1ab-2e7f-4f72-aff5-d9072e10714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:15.169614 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb1ab-2e7f-4f72-aff5-d9072e10714a None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:15.175232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:15.175883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:15.176178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:15.176459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:15.178294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:15.191218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:15.192914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:15.203198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1289/2567] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:25.198900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:39.476144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.484912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfa1c-11c8-4416-aa66-9962c3c9fecc service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.488955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8556b3f-f141-44ca-8ab0-688b98612429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.489605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8556b3f-f141-44ca-8ab0-688b98612429 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.489893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8556b3f-f141-44ca-8ab0-688b98612429 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.490204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8556b3f-f141-44ca-8ab0-688b98612429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.500213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8556b3f-f141-44ca-8ab0-688b98612429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.501654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8556b3f-f141-44ca-8ab0-688b98612429 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.531182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1279/2568] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:43.485971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:43.496893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d313b1b-4029-4a46-938f-e99e3d6469ff service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:43.500669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c87d0-9eee-4c00-812b-69db031ad2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:43.501259 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c87d0-9eee-4c00-812b-69db031ad2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:43.501540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c87d0-9eee-4c00-812b-69db031ad2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:43.501837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c87d0-9eee-4c00-812b-69db031ad2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:43.509634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c87d0-9eee-4c00-812b-69db031ad2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:43.511070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c87d0-9eee-4c00-812b-69db031ad2a8 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:43.519374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1290/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:07:43.828925 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8556b3f-f141-44ca-8ab0-688b98612429 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:43.837597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8556b3f-f141-44ca-8ab0-688b98612429 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:43.841291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac508cce-04aa-4c4d-a736-4f01dcf5e960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:43.841943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508cce-04aa-4c4d-a736-4f01dcf5e960 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:43.842276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508cce-04aa-4c4d-a736-4f01dcf5e960 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:43.842565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508cce-04aa-4c4d-a736-4f01dcf5e960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:43.855080 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac508cce-04aa-4c4d-a736-4f01dcf5e960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:43.856553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac508cce-04aa-4c4d-a736-4f01dcf5e960 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:43.869108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1280/2570] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:45.060006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c87d0-9eee-4c00-812b-69db031ad2a8 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:45.070094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c87d0-9eee-4c00-812b-69db031ad2a8 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:45.074079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:45.074770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:45.075057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:45.075336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:45.086748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:45.088185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:45.100937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1291/2571] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:53.863507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=19 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:55.095033 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=12 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:09.843984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac508cce-04aa-4c4d-a736-4f01dcf5e960 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.853748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac508cce-04aa-4c4d-a736-4f01dcf5e960 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.857512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.858197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.858486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.858767 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.860688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:10.050419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:10.051856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:10.062550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1281/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:17.472689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:17.474292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:17.488894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56263b-c004-479c-a968-596650a1929b service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:17.493509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:17.494556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:17.494849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:17.495132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] PATH_INFO: `/v3/users/ffd80d442d404aaa95e88bac7a937ca2` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:17.512460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd80d442d404aaa95e88bac7a937ca2)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:17.512460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:17.696036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd80d442d404aaa95e88bac7a937ca2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:17.785470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd80d442d404aaa95e88bac7a937ca2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:17.799445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd80d442d404aaa95e88bac7a937ca2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:17.807071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd80d442d404aaa95e88bac7a937ca2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:17.807770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd80d442d404aaa95e88bac7a937ca2'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:17.813700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1292/2573] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:17 2022] DELETE /identity/v3/users/ffd80d442d404aaa95e88bac7a937ca2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:18.066255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.076358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427858c-cb5c-4cf3-b595-e65d4a3086c5 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.134201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.135066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.135350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.135629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] PATH_INFO: `/v3/projects/d8f7faef6eb847fe8c8d243662105271` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.146176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f7faef6eb847fe8c8d243662105271)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.148096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.248567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f7faef6eb847fe8c8d243662105271', 'request_id': 'req-06c2f42a-3b93-469b-92d7-dd8d97161220'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.316775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f7faef6eb847fe8c8d243662105271', 'request_id': 'req-06c2f42a-3b93-469b-92d7-dd8d97161220'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.322816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f7faef6eb847fe8c8d243662105271', 'request_id': 'req-06c2f42a-3b93-469b-92d7-dd8d97161220'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.334512 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] The token cache is being invalidate because project d8f7faef6eb847fe8c8d243662105271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:18.334802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.335450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.337028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1282/2574] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:18 2022] DELETE /identity/v3/projects/d8f7faef6eb847fe8c8d243662105271 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:18.341092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.342546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:18.356233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f803b10-e71c-4113-a9d8-9620fb496acf admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.414870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.415749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.416037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.416316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] PATH_INFO: `/v3/users/be8b507ebb084cb2882b77a93e0c4ce3` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.429874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8b507ebb084cb2882b77a93e0c4ce3)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.431855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.632662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8b507ebb084cb2882b77a93e0c4ce3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.636339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:18.699466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8b507ebb084cb2882b77a93e0c4ce3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.713182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8b507ebb084cb2882b77a93e0c4ce3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.720071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8b507ebb084cb2882b77a93e0c4ce3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.722780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8b507ebb084cb2882b77a93e0c4ce3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.727502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1293/2575] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:18 2022] DELETE /identity/v3/users/be8b507ebb084cb2882b77a93e0c4ce3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:18.975501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.977102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:18.992609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2f42a-3b93-469b-92d7-dd8d97161220 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:19.005946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:19.054467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:19.055358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:19.055640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:19.055914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] PATH_INFO: `/v3/projects/7174ce9837e74ba4b6b80ffbedb44d30` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:19.066580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7174ce9837e74ba4b6b80ffbedb44d30)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:19.068170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:19.208905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7174ce9837e74ba4b6b80ffbedb44d30', 'request_id': 'req-97cd6ea5-4674-49aa-a66e-aa816a070700'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.276813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7174ce9837e74ba4b6b80ffbedb44d30', 'request_id': 'req-97cd6ea5-4674-49aa-a66e-aa816a070700'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.283073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7174ce9837e74ba4b6b80ffbedb44d30', 'request_id': 'req-97cd6ea5-4674-49aa-a66e-aa816a070700'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.294737 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] The token cache is being invalidate because project 7174ce9837e74ba4b6b80ffbedb44d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:19.295015 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.295676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.297211 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1283/2576] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:18 2022] DELETE /identity/v3/projects/7174ce9837e74ba4b6b80ffbedb44d30 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:23.974662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:23.985169 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:24.058551 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34164477-b5c1-4de7-9d9d-b2203e176735 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.127487 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.129509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.129509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.129509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.131245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:24.145108 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.146760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.159230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1294/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:29.291759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:32.394402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:32.395802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:32.468354 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6ea5-4674-49aa-a66e-aa816a070700 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:32.473436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9febe-feec-4f77-98e0-f037a1d93e2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:32.474089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9febe-feec-4f77-98e0-f037a1d93e2f service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.474406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9febe-feec-4f77-98e0-f037a1d93e2f service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.474688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9febe-feec-4f77-98e0-f037a1d93e2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.476505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-47f9febe-feec-4f77-98e0-f037a1d93e2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:32.488649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9febe-feec-4f77-98e0-f037a1d93e2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:32.490204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9febe-feec-4f77-98e0-f037a1d93e2f service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:32.500191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1284/2578] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:34.154512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=74,keystone:DELETE=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:35.118045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:35.119509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:35.178386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010de8a-e4fb-4954-bd0d-f973b1ca35e5 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:35.182243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:35.182901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:35.183189 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:35.183465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:35.185247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:35.287900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:35.289343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:35.308743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1295/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:41.856688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66a33-d50e-4236-8ada-b887653d946e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:41.857206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66a33-d50e-4236-8ada-b887653d946e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:41.857293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66a33-d50e-4236-8ada-b887653d946e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:41.894658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-41a66a33-d50e-4236-8ada-b887653d946e None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:41.895856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-41a66a33-d50e-4236-8ada-b887653d946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:41.949112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1285/2580] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:42.258184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:42.259604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:42.270622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2f6a2-7c75-47b1-9f1f-dc404445e1ed service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:42.274366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:42.275010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:42.275301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:42.275583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:42.277367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:42.287009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:42.288426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:42.297121 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1296/2581] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:42.686786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a66a33-d50e-4236-8ada-b887653d946e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:42.706058 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a66a33-d50e-4236-8ada-b887653d946e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:42.711078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:42.712259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:42.712548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:42.712828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:42.714625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:42.727089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:42.729193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:42.741036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1286/2582] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:51.444911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:51.446471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:51.473635 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0dd58-fd84-4e5e-8753-7a975acd87b6 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:51.479435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744acfa6-4283-46f6-843e-237d38747ba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:51.480205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744acfa6-4283-46f6-843e-237d38747ba0 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:51.480498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744acfa6-4283-46f6-843e-237d38747ba0 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:51.480781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744acfa6-4283-46f6-843e-237d38747ba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:51.483359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-744acfa6-4283-46f6-843e-237d38747ba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:51.496763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744acfa6-4283-46f6-843e-237d38747ba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:51.498467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744acfa6-4283-46f6-843e-237d38747ba0 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:51.510017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1297/2583] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:52.735430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=71 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:55.170407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:55.184214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813471d3-c18e-4126-bd9b-ef15a61d2724 service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:55.191048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:55.192437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:55.192437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:55.192437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:55.194309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:55.207387 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:55.209329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:55.222078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1287/2584] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:58.157550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84906-828f-4431-946e-90e6583169ef None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:58.158035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84906-828f-4431-946e-90e6583169ef None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:58.158162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84906-828f-4431-946e-90e6583169ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:58.177231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-5eb84906-828f-4431-946e-90e6583169ef None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:58.184499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5eb84906-828f-4431-946e-90e6583169ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:58.185457 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1298/2585] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:05.216973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:08.172889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=82 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:04.056673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:04.057988 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:04.115489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc21ee-cdab-4bf0-b696-a8e86899294e service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:04.121334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:04.121992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:04.122312 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:04.122591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:04.124490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:04.138441 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:04.140076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:04.151322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1288/2586] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:12.895361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea960a-c86f-4d1e-9152-c4d591ffddb2 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:12.895893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea960a-c86f-4d1e-9152-c4d591ffddb2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:12.896016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea960a-c86f-4d1e-9152-c4d591ffddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:12.915290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b6ea960a-c86f-4d1e-9152-c4d591ffddb2 None None] MFA Rules not processed for user `ad2748d7c446463e9e97ec6f92299efa`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:12.916506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b6ea960a-c86f-4d1e-9152-c4d591ffddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:12.924405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1299/2587] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:10:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:13.270751 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:13.290586 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0ef1-9e96-4706-83c1-ceabd7f04274 service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:13.294502 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90635bc3-822c-4402-ad7e-39d7956e84c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:13.295213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635bc3-822c-4402-ad7e-39d7956e84c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:13.295508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635bc3-822c-4402-ad7e-39d7956e84c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:13.295807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635bc3-822c-4402-ad7e-39d7956e84c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:13.297736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-90635bc3-822c-4402-ad7e-39d7956e84c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:13.321176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90635bc3-822c-4402-ad7e-39d7956e84c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:13.322679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90635bc3-822c-4402-ad7e-39d7956e84c5 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:13.331258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1289/2588] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:22.908596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:23.327514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=39 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:12.249729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea960a-c86f-4d1e-9152-c4d591ffddb2 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:12.255430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b6ea960a-c86f-4d1e-9152-c4d591ffddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:12.360405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea960a-c86f-4d1e-9152-c4d591ffddb2 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:12.365087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:12.365964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:12.366279 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:12.366555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] PATH_INFO: `/v3/users/ad2748d7c446463e9e97ec6f92299efa` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:12.367753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2748d7c446463e9e97ec6f92299efa)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:12.369664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:12.544191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2748d7c446463e9e97ec6f92299efa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:12.611283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2748d7c446463e9e97ec6f92299efa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:12.623659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2748d7c446463e9e97ec6f92299efa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:12.630415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2748d7c446463e9e97ec6f92299efa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:12.631063 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2748d7c446463e9e97ec6f92299efa'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:12.636876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1300/2589] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:12 2022] DELETE /identity/v3/users/ad2748d7c446463e9e97ec6f92299efa => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:12.641643 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de9283-ee2c-4727-8647-5e08b9076a3d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:12.642153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de9283-ee2c-4727-8647-5e08b9076a3d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:12.642256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de9283-ee2c-4727-8647-5e08b9076a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:12.667934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-34de9283-ee2c-4727-8647-5e08b9076a3d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:12.669124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-34de9283-ee2c-4727-8647-5e08b9076a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:12.727895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1290/2590] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:12.738634 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:12.740060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:12.801984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af93e3-9b75-4ec7-9a6c-d1a1d35d1389 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:12.805576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4dded-57c3-4c05-aff8-acd9890a6eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:12.806328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4dded-57c3-4c05-aff8-acd9890a6eda service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:12.806616 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4dded-57c3-4c05-aff8-acd9890a6eda service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:12.806894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4dded-57c3-4c05-aff8-acd9890a6eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:12.815045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:12.818833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4dded-57c3-4c05-aff8-acd9890a6eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:12.820254 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4dded-57c3-4c05-aff8-acd9890a6eda service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:12.829878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1301/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:13.092681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de9283-ee2c-4727-8647-5e08b9076a3d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:13.094362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-34de9283-ee2c-4727-8647-5e08b9076a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:13.108977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de9283-ee2c-4727-8647-5e08b9076a3d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:13.115437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:13.116331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:13.116613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:13.117481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] PATH_INFO: `/v3/projects/2c57f782327040b6a5209a4b38bf3b6c` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:13.118851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c57f782327040b6a5209a4b38bf3b6c)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:13.120895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:13.232761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c57f782327040b6a5209a4b38bf3b6c', 'request_id': 'req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.302320 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c57f782327040b6a5209a4b38bf3b6c', 'request_id': 'req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.311173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c57f782327040b6a5209a4b38bf3b6c', 'request_id': 'req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.324379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] The token cache is being invalidate because project 2c57f782327040b6a5209a4b38bf3b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:13.324379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.324745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.327188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1291/2592] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:13 2022] DELETE /identity/v3/projects/2c57f782327040b6a5209a4b38bf3b6c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:13.331837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4dded-57c3-4c05-aff8-acd9890a6eda service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:13.342349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4dded-57c3-4c05-aff8-acd9890a6eda service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:13.400729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:13.401630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:13.401898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:13.402218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] PATH_INFO: `/v3/users/cc894f5686bc411196119194b99261e3` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:13.403418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc894f5686bc411196119194b99261e3)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:13.405347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:13.590934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc894f5686bc411196119194b99261e3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.678930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc894f5686bc411196119194b99261e3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.696068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc894f5686bc411196119194b99261e3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.704080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc894f5686bc411196119194b99261e3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.704814 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc894f5686bc411196119194b99261e3'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.710739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1302/2593] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:13 2022] DELETE /identity/v3/users/cc894f5686bc411196119194b99261e3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:14.081352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:14.082842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:14.097170 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae1b3-55b1-4ad4-ae8c-8a237c2c1d04 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:14.158085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:14.158981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:14.159264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:14.159541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] PATH_INFO: `/v3/projects/e9e6786be56b48318aa0a3ed26d9f78a` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:14.160727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e6786be56b48318aa0a3ed26d9f78a)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:14.162672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:14.183963 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:14.252182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e6786be56b48318aa0a3ed26d9f78a', 'request_id': 'req-e24f3c52-f575-4df1-afe4-a8132e7470ec'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.296187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e6786be56b48318aa0a3ed26d9f78a', 'request_id': 'req-e24f3c52-f575-4df1-afe4-a8132e7470ec'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.303047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e6786be56b48318aa0a3ed26d9f78a', 'request_id': 'req-e24f3c52-f575-4df1-afe4-a8132e7470ec'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.314535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] The token cache is being invalidate because project e9e6786be56b48318aa0a3ed26d9f78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:14.314822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.315469 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e24f3c52-f575-4df1-afe4-a8132e7470ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.317008 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1292/2594] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:14 2022] DELETE /identity/v3/projects/e9e6786be56b48318aa0a3ed26d9f78a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:19.393059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:19.394574 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:19.480828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:19.495981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c64d1-4e14-4348-8f25-0191cf7f31f3 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:19.557891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e701c9e-634d-4e42-981e-4e11314d4a78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:19.558647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701c9e-634d-4e42-981e-4e11314d4a78 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:19.558935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701c9e-634d-4e42-981e-4e11314d4a78 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:19.559217 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701c9e-634d-4e42-981e-4e11314d4a78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:19.561055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9e701c9e-634d-4e42-981e-4e11314d4a78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:19.573262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e701c9e-634d-4e42-981e-4e11314d4a78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:19.574975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e701c9e-634d-4e42-981e-4e11314d4a78 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:19.586980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1303/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:20.453410 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ae92-b7ce-4111-8a44-cf6ac07eaefa None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.454672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ae92-b7ce-4111-8a44-cf6ac07eaefa None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.454672 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ae92-b7ce-4111-8a44-cf6ac07eaefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.502934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-96a0ae92-b7ce-4111-8a44-cf6ac07eaefa None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:20.504135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-96a0ae92-b7ce-4111-8a44-cf6ac07eaefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:20.564446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1293/2596] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:20.573601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198973-ff06-48b3-8d46-c8b4600dc17d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.574135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198973-ff06-48b3-8d46-c8b4600dc17d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.574251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198973-ff06-48b3-8d46-c8b4600dc17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.592394 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d0198973-ff06-48b3-8d46-c8b4600dc17d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:20.593631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d0198973-ff06-48b3-8d46-c8b4600dc17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:20.602338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1304/2597] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:20.607028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0ae92-b7ce-4111-8a44-cf6ac07eaefa None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.617251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0ae92-b7ce-4111-8a44-cf6ac07eaefa None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.621910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.622601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.622896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.623178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.623904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:20.624218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.625805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.637196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1294/2598] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:20.645871 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198973-ff06-48b3-8d46-c8b4600dc17d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.655493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198973-ff06-48b3-8d46-c8b4600dc17d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.660986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc8319-ba03-4f20-a6fc-c4822b715118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.661638 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc8319-ba03-4f20-a6fc-c4822b715118 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.661931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc8319-ba03-4f20-a6fc-c4822b715118 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.662248 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc8319-ba03-4f20-a6fc-c4822b715118 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.662940 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc8319-ba03-4f20-a6fc-c4822b715118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.664842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc8319-ba03-4f20-a6fc-c4822b715118 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.789147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1305/2599] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:20.793452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.803911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1c78-10e4-4c9e-9c5c-946517dd757f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.862553 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bb2f0-3f30-457b-bbb4-1f87e69f03f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.863224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bb2f0-3f30-457b-bbb4-1f87e69f03f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.863513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bb2f0-3f30-457b-bbb4-1f87e69f03f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.863792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bb2f0-3f30-457b-bbb4-1f87e69f03f5 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.864478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bb2f0-3f30-457b-bbb4-1f87e69f03f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.866565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bb2f0-3f30-457b-bbb4-1f87e69f03f5 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.977561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:20.983107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1295/2600] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:20.987164 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc8319-ba03-4f20-a6fc-c4822b715118 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.997988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc8319-ba03-4f20-a6fc-c4822b715118 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.003087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5a43f-cc5d-4f4a-95f9-21f83bae5046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.003899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5a43f-cc5d-4f4a-95f9-21f83bae5046 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.004185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5a43f-cc5d-4f4a-95f9-21f83bae5046 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.004467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5a43f-cc5d-4f4a-95f9-21f83bae5046 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.005243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5a43f-cc5d-4f4a-95f9-21f83bae5046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.006852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5a43f-cc5d-4f4a-95f9-21f83bae5046 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.018187 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1306/2601] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:21.022247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bb2f0-3f30-457b-bbb4-1f87e69f03f5 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.032975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bb2f0-3f30-457b-bbb4-1f87e69f03f5 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.037738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30316d-36c7-4c60-bf05-9f13e72ee8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.038434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30316d-36c7-4c60-bf05-9f13e72ee8dd admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.038720 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30316d-36c7-4c60-bf05-9f13e72ee8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.038998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30316d-36c7-4c60-bf05-9f13e72ee8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.039730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30316d-36c7-4c60-bf05-9f13e72ee8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.041313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30316d-36c7-4c60-bf05-9f13e72ee8dd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.051258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1296/2602] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:21.055608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5a43f-cc5d-4f4a-95f9-21f83bae5046 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.066497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5a43f-cc5d-4f4a-95f9-21f83bae5046 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.071154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f440e9-4800-4f67-836d-518c86970926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.072071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f440e9-4800-4f67-836d-518c86970926 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.072363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f440e9-4800-4f67-836d-518c86970926 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.072645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f440e9-4800-4f67-836d-518c86970926 admin admin] PATH_INFO: `/v3/projects/f300ee2748694d6fbd65436c93f9fd94/users/35a10f230e504bda8037327ce7117dee/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.088621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f440e9-4800-4f67-836d-518c86970926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f300ee2748694d6fbd65436c93f9fd94, user_id=35a10f230e504bda8037327ce7117dee, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.091410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f440e9-4800-4f67-836d-518c86970926 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.171543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1307/2603] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:21 2022] PUT /identity/v3/projects/f300ee2748694d6fbd65436c93f9fd94/users/35a10f230e504bda8037327ce7117dee/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:21.184929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323f2ca-468f-4302-8a0e-a38a69e81deb None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.185214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323f2ca-468f-4302-8a0e-a38a69e81deb None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.185508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323f2ca-468f-4302-8a0e-a38a69e81deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.213195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-9323f2ca-468f-4302-8a0e-a38a69e81deb None None] MFA Rules not processed for user `35a10f230e504bda8037327ce7117dee`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:21.214441 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9323f2ca-468f-4302-8a0e-a38a69e81deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:21.283532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1297/2604] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:21.288292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f440e9-4800-4f67-836d-518c86970926 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.350653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f440e9-4800-4f67-836d-518c86970926 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.355615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c3e5a-9f83-475c-adda-22ff64f8f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.356277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c3e5a-9f83-475c-adda-22ff64f8f83f admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.356630 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c3e5a-9f83-475c-adda-22ff64f8f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.357042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c3e5a-9f83-475c-adda-22ff64f8f83f admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.358324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c3e5a-9f83-475c-adda-22ff64f8f83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.360039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c3e5a-9f83-475c-adda-22ff64f8f83f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.496140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:21.504754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1308/2605] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:21 2022] POST /identity/v3/projects => generated 393 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:21.509083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323f2ca-468f-4302-8a0e-a38a69e81deb None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.520699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323f2ca-468f-4302-8a0e-a38a69e81deb None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.575794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc307dc-0a00-4289-9a62-bf739b3ba0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.576382 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc307dc-0a00-4289-9a62-bf739b3ba0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.576655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc307dc-0a00-4289-9a62-bf739b3ba0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.576932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc307dc-0a00-4289-9a62-bf739b3ba0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.577609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc307dc-0a00-4289-9a62-bf739b3ba0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.580218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc307dc-0a00-4289-9a62-bf739b3ba0f2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.668655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1298/2606] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:21 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:21.673285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c3e5a-9f83-475c-adda-22ff64f8f83f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.684754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c3e5a-9f83-475c-adda-22ff64f8f83f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.689994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438376e8-1f62-4f0b-a57b-ddc8a07f3779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.690672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438376e8-1f62-4f0b-a57b-ddc8a07f3779 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.690956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438376e8-1f62-4f0b-a57b-ddc8a07f3779 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.691234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438376e8-1f62-4f0b-a57b-ddc8a07f3779 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.691980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438376e8-1f62-4f0b-a57b-ddc8a07f3779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.693571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438376e8-1f62-4f0b-a57b-ddc8a07f3779 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.706455 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1309/2607] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:21.710835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc307dc-0a00-4289-9a62-bf739b3ba0f2 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.721113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc307dc-0a00-4289-9a62-bf739b3ba0f2 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.725805 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d437333-4711-4842-afd5-393d40b21c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.726713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437333-4711-4842-afd5-393d40b21c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.726993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437333-4711-4842-afd5-393d40b21c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.727266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437333-4711-4842-afd5-393d40b21c87 admin admin] PATH_INFO: `/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0/users/3e2d28a460aa4e35a93b1031f366f002/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.742703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d437333-4711-4842-afd5-393d40b21c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c55bf24430d4bf98e8b0bd04fdb16a0, user_id=3e2d28a460aa4e35a93b1031f366f002, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.745359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d437333-4711-4842-afd5-393d40b21c87 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.891005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1299/2608] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:21 2022] PUT /identity/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0/users/3e2d28a460aa4e35a93b1031f366f002/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:21.895334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438376e8-1f62-4f0b-a57b-ddc8a07f3779 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.908165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438376e8-1f62-4f0b-a57b-ddc8a07f3779 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.972428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8ce69-3110-49d5-bcff-49f3122bce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.973104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8ce69-3110-49d5-bcff-49f3122bce3c admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.973391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8ce69-3110-49d5-bcff-49f3122bce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.973672 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8ce69-3110-49d5-bcff-49f3122bce3c admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.974490 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8ce69-3110-49d5-bcff-49f3122bce3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.976286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8ce69-3110-49d5-bcff-49f3122bce3c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.987651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1310/2609] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:21.991977 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d437333-4711-4842-afd5-393d40b21c87 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:22.002984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d437333-4711-4842-afd5-393d40b21c87 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:22.008331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453141e-d4f1-40c4-8ae4-e8607f0fc5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:22.009330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453141e-d4f1-40c4-8ae4-e8607f0fc5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:22.009612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453141e-d4f1-40c4-8ae4-e8607f0fc5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:22.009891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453141e-d4f1-40c4-8ae4-e8607f0fc5ef admin admin] PATH_INFO: `/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0/users/3e2d28a460aa4e35a93b1031f366f002/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:22.012576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453141e-d4f1-40c4-8ae4-e8607f0fc5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c55bf24430d4bf98e8b0bd04fdb16a0, user_id=3e2d28a460aa4e35a93b1031f366f002, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:22.015268 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453141e-d4f1-40c4-8ae4-e8607f0fc5ef admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:22.167192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1300/2610] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:21 2022] PUT /identity/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0/users/3e2d28a460aa4e35a93b1031f366f002/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:22.177337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e33a-e7e5-4060-8ed8-92847bb22ef2 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:22.177691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e33a-e7e5-4060-8ed8-92847bb22ef2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:22.177976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e33a-e7e5-4060-8ed8-92847bb22ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:22.207641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e276e33a-e7e5-4060-8ed8-92847bb22ef2 None None] MFA Rules not processed for user `3e2d28a460aa4e35a93b1031f366f002`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:22.208904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e276e33a-e7e5-4060-8ed8-92847bb22ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:22.279991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1311/2611] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:22.291851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dbc4-2cf2-4815-820a-9b92594e0fd4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:22.292135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dbc4-2cf2-4815-820a-9b92594e0fd4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:22.292413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dbc4-2cf2-4815-820a-9b92594e0fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:22.309897 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c3a9dbc4-2cf2-4815-820a-9b92594e0fd4 None None] MFA Rules not processed for user `35a10f230e504bda8037327ce7117dee`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:22.311136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c3a9dbc4-2cf2-4815-820a-9b92594e0fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:22.338630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:22.369179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1301/2612] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:22.382756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276e33a-e7e5-4060-8ed8-92847bb22ef2 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:22.384151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e276e33a-e7e5-4060-8ed8-92847bb22ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:22.458726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276e33a-e7e5-4060-8ed8-92847bb22ef2 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:22.464314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35688481-f334-485b-a248-26756edb90fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:22.464963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688481-f334-485b-a248-26756edb90fb service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:22.465277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688481-f334-485b-a248-26756edb90fb service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:22.465555 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688481-f334-485b-a248-26756edb90fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:22.470272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:22.474952 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35688481-f334-485b-a248-26756edb90fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:22.476515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35688481-f334-485b-a248-26756edb90fb service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:22.485528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1312/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:32.398937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=11 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:32.501725 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:34.837706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9dbc4-2cf2-4815-820a-9b92594e0fd4 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:34.851651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9dbc4-2cf2-4815-820a-9b92594e0fd4 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:34.857249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:34.857902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.858228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.858515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.867642 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:34.869241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:34.879391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1302/2614] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:34.893640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ea83-3221-4420-921a-555b2369a706 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.894067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ea83-3221-4420-921a-555b2369a706 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.894216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ea83-3221-4420-921a-555b2369a706 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.895623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1313/2615] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jul 11 15:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:11:34.900273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] Authenticating service token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:11:34.912625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 11 15:11:34.912864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:34.921871 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efbb20-710a-4f71-b68a-ce21e73ffc11 service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:34.926571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2d28a460aa4e35a93b1031f366f002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c55bf24430d4bf98e8b0bd04fdb16a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:34.927432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.927726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.928005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] PATH_INFO: `/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.929232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] RBAC: Authorizing `identity:get_project(project_id=5c55bf24430d4bf98e8b0bd04fdb16a0)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:34.931052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:34.932753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1303/2616] 10.222.0.20 () {58 vars in 1443 bytes} [Mon Jul 11 15:11:34 2022] GET /identity/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0 => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:35.392974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298732f-48e6-48f9-9e4a-9bd045b02787 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.393769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298732f-48e6-48f9-9e4a-9bd045b02787 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.394053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298732f-48e6-48f9-9e4a-9bd045b02787 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.395516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1314/2617] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jul 11 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:11:35.400475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] Authenticating service token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:11:35.402674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:35.421550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.427700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db9c47-bc90-4277-b20d-592b2d04061b tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.432255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb988c8a-2a89-42a5-958f-31781d01bd55 tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2d28a460aa4e35a93b1031f366f002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c55bf24430d4bf98e8b0bd04fdb16a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.433167 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988c8a-2a89-42a5-958f-31781d01bd55 tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.433447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988c8a-2a89-42a5-958f-31781d01bd55 tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.433725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988c8a-2a89-42a5-958f-31781d01bd55 tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] PATH_INFO: `/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.434954 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb988c8a-2a89-42a5-958f-31781d01bd55 tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] RBAC: Authorizing `identity:get_project(project_id=5c55bf24430d4bf98e8b0bd04fdb16a0)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:35.436729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb988c8a-2a89-42a5-958f-31781d01bd55 tempest-ServersAdminNegativeTestJSON-1259725465 tempest-ServersAdminNegativeTestJSON-1259725465-project-admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.438445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1304/2618] 10.222.0.20 () {58 vars in 1443 bytes} [Mon Jul 11 15:11:35 2022] GET /identity/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0 => generated 393 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:39.672041 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298732f-48e6-48f9-9e4a-9bd045b02787 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:39.736867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298732f-48e6-48f9-9e4a-9bd045b02787 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:39.742081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:39.742990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:39.743370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:39.743657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] PATH_INFO: `/v3/users/35a10f230e504bda8037327ce7117dee` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:39.744989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a10f230e504bda8037327ce7117dee)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:39.746961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:39.881106 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a10f230e504bda8037327ce7117dee'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:39.930361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a10f230e504bda8037327ce7117dee'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:39.943849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a10f230e504bda8037327ce7117dee'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:39.951024 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a10f230e504bda8037327ce7117dee'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:39.951881 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a10f230e504bda8037327ce7117dee'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:39.957935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1315/2619] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:39 2022] DELETE /identity/v3/users/35a10f230e504bda8037327ce7117dee => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:39.962624 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb5014-37df-483b-a4e8-605c3cfb0ab3 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:39.963117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb5014-37df-483b-a4e8-605c3cfb0ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:39.963226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb5014-37df-483b-a4e8-605c3cfb0ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:39.982763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d1fb5014-37df-483b-a4e8-605c3cfb0ab3 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:39.984061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d1fb5014-37df-483b-a4e8-605c3cfb0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:40.043906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1305/2620] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:40.054426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:40.055928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:40.115639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad35c30-1dd0-4cf5-acdd-85db1c43b172 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:40.119608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861c08b-5936-4df2-9177-694a397a7701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:40.120270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c08b-5936-4df2-9177-694a397a7701 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:40.120589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c08b-5936-4df2-9177-694a397a7701 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:40.120923 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c08b-5936-4df2-9177-694a397a7701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:40.130830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861c08b-5936-4df2-9177-694a397a7701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:40.132302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861c08b-5936-4df2-9177-694a397a7701 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:40.142073 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1316/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:40.396175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb5014-37df-483b-a4e8-605c3cfb0ab3 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:40.396175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d1fb5014-37df-483b-a4e8-605c3cfb0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:40.408246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb5014-37df-483b-a4e8-605c3cfb0ab3 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:40.413789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:40.414691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:40.415011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:40.415280 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] PATH_INFO: `/v3/projects/f300ee2748694d6fbd65436c93f9fd94` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:40.416458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f300ee2748694d6fbd65436c93f9fd94)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:40.418401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:40.530998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f300ee2748694d6fbd65436c93f9fd94', 'request_id': 'req-765de5b9-9612-4cd0-b135-27289ff77382'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.604733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f300ee2748694d6fbd65436c93f9fd94', 'request_id': 'req-765de5b9-9612-4cd0-b135-27289ff77382'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.611711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f300ee2748694d6fbd65436c93f9fd94', 'request_id': 'req-765de5b9-9612-4cd0-b135-27289ff77382'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.623242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] The token cache is being invalidate because project f300ee2748694d6fbd65436c93f9fd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:40.626077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.626077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.626077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1306/2622] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:40 2022] DELETE /identity/v3/projects/f300ee2748694d6fbd65436c93f9fd94 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:40.630379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861c08b-5936-4df2-9177-694a397a7701 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:40.640092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861c08b-5936-4df2-9177-694a397a7701 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:40.659880 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:40.698241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:40.699123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:40.699408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:40.699689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] PATH_INFO: `/v3/users/3e2d28a460aa4e35a93b1031f366f002` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:40.700894 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2d28a460aa4e35a93b1031f366f002)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:40.702898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:40.869825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2d28a460aa4e35a93b1031f366f002'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.924339 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2d28a460aa4e35a93b1031f366f002'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.938085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2d28a460aa4e35a93b1031f366f002'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.946015 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2d28a460aa4e35a93b1031f366f002'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.946731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-beffa2ce-8285-4978-8519-4145c65c5a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2d28a460aa4e35a93b1031f366f002'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.952686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1317/2623] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:40 2022] DELETE /identity/v3/users/3e2d28a460aa4e35a93b1031f366f002 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:41.371709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:41.373186 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:41.388112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765de5b9-9612-4cd0-b135-27289ff77382 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:41.442484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:41.453140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:41.455006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:41.455006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:41.455006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] PATH_INFO: `/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:41.457852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c55bf24430d4bf98e8b0bd04fdb16a0)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:41.460024 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:41.589933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c55bf24430d4bf98e8b0bd04fdb16a0', 'request_id': 'req-e7e5b226-d38d-4e2b-88be-b0869f5c5777'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:41.638914 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c55bf24430d4bf98e8b0bd04fdb16a0', 'request_id': 'req-e7e5b226-d38d-4e2b-88be-b0869f5c5777'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:41.645747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c55bf24430d4bf98e8b0bd04fdb16a0', 'request_id': 'req-e7e5b226-d38d-4e2b-88be-b0869f5c5777'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:41.657521 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] The token cache is being invalidate because project 5c55bf24430d4bf98e8b0bd04fdb16a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:41.657860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:41.658551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-e7e5b226-d38d-4e2b-88be-b0869f5c5777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:41.660164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1307/2624] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:41 2022] DELETE /identity/v3/projects/5c55bf24430d4bf98e8b0bd04fdb16a0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:41.666689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047de202-58f6-4ec0-b2f0-df0f60c06f87 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:41.666995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047de202-58f6-4ec0-b2f0-df0f60c06f87 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:41.667284 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047de202-58f6-4ec0-b2f0-df0f60c06f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:41.685222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-047de202-58f6-4ec0-b2f0-df0f60c06f87 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:41.686476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-047de202-58f6-4ec0-b2f0-df0f60c06f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:41.748372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1318/2625] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:41.757427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eae2d4-bbb9-4fe7-a18d-47c43b5fb0dc None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:41.757747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eae2d4-bbb9-4fe7-a18d-47c43b5fb0dc None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:41.758027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eae2d4-bbb9-4fe7-a18d-47c43b5fb0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:41.776231 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a1eae2d4-bbb9-4fe7-a18d-47c43b5fb0dc None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:41.777448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a1eae2d4-bbb9-4fe7-a18d-47c43b5fb0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:41.785402 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1308/2626] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:41.789649 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047de202-58f6-4ec0-b2f0-df0f60c06f87 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:41.800109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047de202-58f6-4ec0-b2f0-df0f60c06f87 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:41.804805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:41.805465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:41.805756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:41.806040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:41.806803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:41.807119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:41.808710 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:41.821503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1319/2627] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:41.825683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eae2d4-bbb9-4fe7-a18d-47c43b5fb0dc None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:41.835189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eae2d4-bbb9-4fe7-a18d-47c43b5fb0dc None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:41.840002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc219326-b5c6-4f28-ae62-4703c512c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:41.840649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219326-b5c6-4f28-ae62-4703c512c5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:41.840928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219326-b5c6-4f28-ae62-4703c512c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:41.841204 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219326-b5c6-4f28-ae62-4703c512c5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:41.841894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc219326-b5c6-4f28-ae62-4703c512c5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:41.843810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc219326-b5c6-4f28-ae62-4703c512c5a2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:41.961163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1309/2628] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:41 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:41.965283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:41.976644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e840fe-cf7c-4105-b150-3e92cde46b68 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:42.004832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:42.038943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884c3f-9a54-4697-8229-6a8f14f13835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:42.039643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884c3f-9a54-4697-8229-6a8f14f13835 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:42.040324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884c3f-9a54-4697-8229-6a8f14f13835 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:42.040571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884c3f-9a54-4697-8229-6a8f14f13835 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:42.041300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884c3f-9a54-4697-8229-6a8f14f13835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:42.043333 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884c3f-9a54-4697-8229-6a8f14f13835 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:42.153749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1320/2629] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:41 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:42.158286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc219326-b5c6-4f28-ae62-4703c512c5a2 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:42.169182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc219326-b5c6-4f28-ae62-4703c512c5a2 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:42.174334 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e349e-872c-4951-8b13-b518712b91cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:42.175755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e349e-872c-4951-8b13-b518712b91cb admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:42.175888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e349e-872c-4951-8b13-b518712b91cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:42.176100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e349e-872c-4951-8b13-b518712b91cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:42.176998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e349e-872c-4951-8b13-b518712b91cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:42.178632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e349e-872c-4951-8b13-b518712b91cb admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:42.190650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1310/2630] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:42.194694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884c3f-9a54-4697-8229-6a8f14f13835 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:42.204801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884c3f-9a54-4697-8229-6a8f14f13835 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:42.209641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e325588-8a56-4ec9-939b-57178c089e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:42.210329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e325588-8a56-4ec9-939b-57178c089e35 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:42.210610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e325588-8a56-4ec9-939b-57178c089e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:42.210887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e325588-8a56-4ec9-939b-57178c089e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:42.211606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e325588-8a56-4ec9-939b-57178c089e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:42.213198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e325588-8a56-4ec9-939b-57178c089e35 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:42.223803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1321/2631] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:42.227939 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e349e-872c-4951-8b13-b518712b91cb admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:42.239102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e349e-872c-4951-8b13-b518712b91cb admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:42.243681 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:42.244549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:42.244831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:42.245109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] PATH_INFO: `/v3/projects/18fe0924f7b24951bd84562812122685/users/f505761d62ad4164ad3076d45749b1f7/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:42.259802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fe0924f7b24951bd84562812122685, user_id=f505761d62ad4164ad3076d45749b1f7, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:42.262449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:42.348100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1311/2632] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:42 2022] PUT /identity/v3/projects/18fe0924f7b24951bd84562812122685/users/f505761d62ad4164ad3076d45749b1f7/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:42.353176 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41e29a-dbfd-460f-898c-c06891dc399a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:42.353471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41e29a-dbfd-460f-898c-c06891dc399a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:42.360321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41e29a-dbfd-460f-898c-c06891dc399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:42.372212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-fa41e29a-dbfd-460f-898c-c06891dc399a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:42.374032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fa41e29a-dbfd-460f-898c-c06891dc399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:42.433586 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1322/2633] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:42.443649 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:42.445536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:42.502714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecab0aa-2a1e-4a7d-a30c-d13329b237a9 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:42.506404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34e18-2e4b-4795-b6b0-2f74cda9a8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:42.507041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34e18-2e4b-4795-b6b0-2f74cda9a8fa service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:42.507322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34e18-2e4b-4795-b6b0-2f74cda9a8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:42.507594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34e18-2e4b-4795-b6b0-2f74cda9a8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:42.517011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34e18-2e4b-4795-b6b0-2f74cda9a8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:42.519063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34e18-2e4b-4795-b6b0-2f74cda9a8fa service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:42.528655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1312/2634] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:47.891626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccb0fe-d10f-4ab6-8781-bc20d70e34a6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:47.892137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccb0fe-d10f-4ab6-8781-bc20d70e34a6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:47.892218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccb0fe-d10f-4ab6-8781-bc20d70e34a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:47.923766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-42ccb0fe-d10f-4ab6-8781-bc20d70e34a6 None None] MFA Rules not processed for user `f505761d62ad4164ad3076d45749b1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:47.925536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-42ccb0fe-d10f-4ab6-8781-bc20d70e34a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:48.005493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1323/2635] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:48.018306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50767-7a75-421c-9b20-d5d495219c75 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:48.018881 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50767-7a75-421c-9b20-d5d495219c75 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:48.018995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50767-7a75-421c-9b20-d5d495219c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:48.037658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-26e50767-7a75-421c-9b20-d5d495219c75 None None] MFA Rules not processed for user `f505761d62ad4164ad3076d45749b1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:48.038934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-26e50767-7a75-421c-9b20-d5d495219c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:48.050855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1313/2636] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:48.060056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccb0fe-d10f-4ab6-8781-bc20d70e34a6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:48.061483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-42ccb0fe-d10f-4ab6-8781-bc20d70e34a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:48.108975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:48.145361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccb0fe-d10f-4ab6-8781-bc20d70e34a6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:48.151155 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad500e5-d418-4364-b978-ee38f7e2cb79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:48.151899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad500e5-d418-4364-b978-ee38f7e2cb79 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:48.152318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad500e5-d418-4364-b978-ee38f7e2cb79 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:48.152603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad500e5-d418-4364-b978-ee38f7e2cb79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:48.162038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad500e5-d418-4364-b978-ee38f7e2cb79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:48.163780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad500e5-d418-4364-b978-ee38f7e2cb79 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:48.175989 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1324/2637] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:58.032352 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:58.173906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=17 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:01.392534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8281b5-6d8f-454d-abb7-5bb965053d44 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:01.393099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8281b5-6d8f-454d-abb7-5bb965053d44 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:01.393099 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8281b5-6d8f-454d-abb7-5bb965053d44 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:01.394498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1314/2638] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:12:01.400854 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64670-2c95-4cc1-bc3c-a4ad07d81953 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:01.402516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64670-2c95-4cc1-bc3c-a4ad07d81953 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:01.402516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64670-2c95-4cc1-bc3c-a4ad07d81953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:01.436439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-16e64670-2c95-4cc1-bc3c-a4ad07d81953 None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:01.437644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-16e64670-2c95-4cc1-bc3c-a4ad07d81953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:01.444721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1325/2639] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:12:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:01.456528 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8281b5-6d8f-454d-abb7-5bb965053d44 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:01.468427 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8281b5-6d8f-454d-abb7-5bb965053d44 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:01.471920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6f419-f323-4d08-8426-2757118f9002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:01.472554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f419-f323-4d08-8426-2757118f9002 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:01.472840 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f419-f323-4d08-8426-2757118f9002 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:01.473120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f419-f323-4d08-8426-2757118f9002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:01.480213 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6f419-f323-4d08-8426-2757118f9002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:01.481636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6f419-f323-4d08-8426-2757118f9002 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:01.489763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1315/2640] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:01.629171 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94c9e7-5331-4f76-9ef2-c6dcec6e3058 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:01.630132 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94c9e7-5331-4f76-9ef2-c6dcec6e3058 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:01.630423 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94c9e7-5331-4f76-9ef2-c6dcec6e3058 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:01.631982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1326/2641] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:12:01.636634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305b816-03f6-4e72-8514-7350e75f362c None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:01.636960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305b816-03f6-4e72-8514-7350e75f362c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:01.637244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305b816-03f6-4e72-8514-7350e75f362c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:01.673192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4305b816-03f6-4e72-8514-7350e75f362c None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:01.674449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4305b816-03f6-4e72-8514-7350e75f362c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:01.736324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1316/2642] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:12:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:01.757465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94c9e7-5331-4f76-9ef2-c6dcec6e3058 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:01.759190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1d94c9e7-5331-4f76-9ef2-c6dcec6e3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:01.775398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94c9e7-5331-4f76-9ef2-c6dcec6e3058 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:01.780571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942a2b-ba17-430d-a112-95f372b5b5d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:01.781243 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942a2b-ba17-430d-a112-95f372b5b5d9 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:01.781532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942a2b-ba17-430d-a112-95f372b5b5d9 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:01.781811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942a2b-ba17-430d-a112-95f372b5b5d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:01.790323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942a2b-ba17-430d-a112-95f372b5b5d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:01.791885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942a2b-ba17-430d-a112-95f372b5b5d9 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:01.802086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1327/2643] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:02.126979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305b816-03f6-4e72-8514-7350e75f362c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:02.136768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305b816-03f6-4e72-8514-7350e75f362c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:02.140367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:02.141007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:02.141292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:02.141568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:02.143355 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:02.156705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:02.158141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:02.169411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1317/2644] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:12:11.797532 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=15 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:12.164737 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=47 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:44.738726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942a2b-ba17-430d-a112-95f372b5b5d9 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:44.754815 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942a2b-ba17-430d-a112-95f372b5b5d9 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:44.759601 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:44.760341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:44.760781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:44.761066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:44.763223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:44.803257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:44.804768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:44.828470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1328/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:49.633221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:49.643654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deec79-b417-49a0-9e37-0b9d50077ff1 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:49.649158 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:49.650140 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:49.650433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:49.650714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] PATH_INFO: `/v3/users/f505761d62ad4164ad3076d45749b1f7` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:49.651944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f505761d62ad4164ad3076d45749b1f7)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:49.654071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:49.788723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f505761d62ad4164ad3076d45749b1f7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:49.859841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f505761d62ad4164ad3076d45749b1f7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:49.872723 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f505761d62ad4164ad3076d45749b1f7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:49.873423 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f505761d62ad4164ad3076d45749b1f7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:49.880777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-c840419e-45af-4219-bc4b-dc3cfd360c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f505761d62ad4164ad3076d45749b1f7'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:49.887344 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1318/2646] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:49 2022] DELETE /identity/v3/users/f505761d62ad4164ad3076d45749b1f7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:50.147433 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:50.168759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec934e7-8c2a-4fe3-84f9-8883dbac73d4 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:50.222570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:50.223440 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.223730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.224014 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] PATH_INFO: `/v3/projects/18fe0924f7b24951bd84562812122685` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.225228 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18fe0924f7b24951bd84562812122685)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:50.227187 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:50.311501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18fe0924f7b24951bd84562812122685', 'request_id': 'req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:50.351605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18fe0924f7b24951bd84562812122685', 'request_id': 'req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:50.359235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18fe0924f7b24951bd84562812122685', 'request_id': 'req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:50.369524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] The token cache is being invalidate because project 18fe0924f7b24951bd84562812122685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:50.369813 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:50.370482 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ddb1e153-293b-4e9a-9acf-09aa91fd5f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:50.372017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1329/2647] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:50 2022] DELETE /identity/v3/projects/18fe0924f7b24951bd84562812122685 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:50.377152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0df80-f744-4174-b92d-f315949ba08e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.377446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0df80-f744-4174-b92d-f315949ba08e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.377733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0df80-f744-4174-b92d-f315949ba08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.395582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-eba0df80-f744-4174-b92d-f315949ba08e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:50.396746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-eba0df80-f744-4174-b92d-f315949ba08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:50.458899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1319/2648] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:50.467179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c7dca-9b9a-4ad1-b545-419baf6354ba None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.467469 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c7dca-9b9a-4ad1-b545-419baf6354ba None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.467776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c7dca-9b9a-4ad1-b545-419baf6354ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.486966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-829c7dca-9b9a-4ad1-b545-419baf6354ba None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:50.488167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-829c7dca-9b9a-4ad1-b545-419baf6354ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:50.496134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1330/2649] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:50.500215 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0df80-f744-4174-b92d-f315949ba08e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:50.510311 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0df80-f744-4174-b92d-f315949ba08e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:50.514940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:50.515592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.515882 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.516161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.516886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:12:50.517196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:50.518831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:50.530867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1320/2650] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:12:50.534936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c7dca-9b9a-4ad1-b545-419baf6354ba None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:50.544948 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c7dca-9b9a-4ad1-b545-419baf6354ba None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:50.549606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33219-9511-46ee-afaf-5feb0db83817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:50.550878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33219-9511-46ee-afaf-5feb0db83817 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.551166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33219-9511-46ee-afaf-5feb0db83817 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.551448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33219-9511-46ee-afaf-5feb0db83817 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.552130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec33219-9511-46ee-afaf-5feb0db83817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:50.554067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec33219-9511-46ee-afaf-5feb0db83817 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:50.667536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1331/2651] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:12:50 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:50.671569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:50.681829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2cab-9174-4dab-a598-4e1408edd84c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:50.737991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae498f-6886-4202-99e8-817ae4ac9302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:50.738693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae498f-6886-4202-99e8-817ae4ac9302 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.738983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae498f-6886-4202-99e8-817ae4ac9302 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.739258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae498f-6886-4202-99e8-817ae4ac9302 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.739950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae498f-6886-4202-99e8-817ae4ac9302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:50.741875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae498f-6886-4202-99e8-817ae4ac9302 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:50.748621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:50.814633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1321/2652] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:12:50 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:50.818825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33219-9511-46ee-afaf-5feb0db83817 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:50.830209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33219-9511-46ee-afaf-5feb0db83817 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:50.835211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cdbda-1231-4219-b701-7c5ac99b8936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:50.835888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cdbda-1231-4219-b701-7c5ac99b8936 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.836192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cdbda-1231-4219-b701-7c5ac99b8936 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.836470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cdbda-1231-4219-b701-7c5ac99b8936 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.837852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cdbda-1231-4219-b701-7c5ac99b8936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:50.839471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cdbda-1231-4219-b701-7c5ac99b8936 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:50.849990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1332/2653] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:50.854084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae498f-6886-4202-99e8-817ae4ac9302 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:50.864417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae498f-6886-4202-99e8-817ae4ac9302 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:50.869026 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8e366-04f0-410a-b7a0-d7abc817959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:50.869678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8e366-04f0-410a-b7a0-d7abc817959c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.869965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8e366-04f0-410a-b7a0-d7abc817959c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.870283 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8e366-04f0-410a-b7a0-d7abc817959c admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.871004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8e366-04f0-410a-b7a0-d7abc817959c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:50.872594 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8e366-04f0-410a-b7a0-d7abc817959c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:50.882407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1322/2654] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:50.887100 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cdbda-1231-4219-b701-7c5ac99b8936 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:50.897302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cdbda-1231-4219-b701-7c5ac99b8936 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:50.902623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:50.903499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:50.903787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:50.904069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] PATH_INFO: `/v3/projects/07af555a10a543f0b733b5af94d8eb12/users/356997615725481eaf8c64cef99d9b4e/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:50.912016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:50.921295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07af555a10a543f0b733b5af94d8eb12, user_id=356997615725481eaf8c64cef99d9b4e, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:50.922241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:50.997722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1333/2655] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:12:50 2022] PUT /identity/v3/projects/07af555a10a543f0b733b5af94d8eb12/users/356997615725481eaf8c64cef99d9b4e/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:51.003083 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737130f7-3a73-4af9-a43e-d024bafc1b8f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:51.003380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737130f7-3a73-4af9-a43e-d024bafc1b8f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:51.003665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737130f7-3a73-4af9-a43e-d024bafc1b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:51.022738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-737130f7-3a73-4af9-a43e-d024bafc1b8f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:51.023983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-737130f7-3a73-4af9-a43e-d024bafc1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:51.082710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1323/2656] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:51.092943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:51.095348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:51.150950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e147-5bde-46ac-85ea-a8da8900ac27 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:51.154626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67af67-a00d-4ae6-bc4b-f497f67d2236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:51.155265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67af67-a00d-4ae6-bc4b-f497f67d2236 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:51.155548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67af67-a00d-4ae6-bc4b-f497f67d2236 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:51.155822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67af67-a00d-4ae6-bc4b-f497f67d2236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:51.164843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67af67-a00d-4ae6-bc4b-f497f67d2236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:51.166299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67af67-a00d-4ae6-bc4b-f497f67d2236 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:51.175811 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1334/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:56.261078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436af45-2448-4975-9f19-97ad5f26bf71 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:56.262801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436af45-2448-4975-9f19-97ad5f26bf71 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:56.262801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436af45-2448-4975-9f19-97ad5f26bf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:56.295583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b436af45-2448-4975-9f19-97ad5f26bf71 None None] MFA Rules not processed for user `356997615725481eaf8c64cef99d9b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:56.296981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b436af45-2448-4975-9f19-97ad5f26bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:56.369656 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1324/2658] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:12:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:56.380295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78fbb-3315-4f49-a68b-0566d2702d4e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:56.380793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78fbb-3315-4f49-a68b-0566d2702d4e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:56.380886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78fbb-3315-4f49-a68b-0566d2702d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:56.399258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-fec78fbb-3315-4f49-a68b-0566d2702d4e None None] MFA Rules not processed for user `356997615725481eaf8c64cef99d9b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:56.400507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fec78fbb-3315-4f49-a68b-0566d2702d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:56.408272 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1335/2659] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:12:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:56.421792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436af45-2448-4975-9f19-97ad5f26bf71 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:56.423323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b436af45-2448-4975-9f19-97ad5f26bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:56.502513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436af45-2448-4975-9f19-97ad5f26bf71 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:56.509525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5e1b-8cc1-46d2-bee4-91009d56335b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:56.510241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5e1b-8cc1-46d2-bee4-91009d56335b service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:56.510530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5e1b-8cc1-46d2-bee4-91009d56335b service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:56.510812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5e1b-8cc1-46d2-bee4-91009d56335b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:56.516019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:56.519969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab5e1b-8cc1-46d2-bee4-91009d56335b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:56.521745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab5e1b-8cc1-46d2-bee4-91009d56335b service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:56.531565 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1325/2660] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:57.211223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec78fbb-3315-4f49-a68b-0566d2702d4e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:57.226776 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec78fbb-3315-4f49-a68b-0566d2702d4e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:57.236735 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5873371-103a-4423-9652-21f2e088c35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:57.237574 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873371-103a-4423-9652-21f2e088c35c service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:57.238026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873371-103a-4423-9652-21f2e088c35c service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:57.238465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873371-103a-4423-9652-21f2e088c35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:57.242575 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d5873371-103a-4423-9652-21f2e088c35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:57.262942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5873371-103a-4423-9652-21f2e088c35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:57.264380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5873371-103a-4423-9652-21f2e088c35c service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:57.276963 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1336/2661] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:00.303686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5e1b-8cc1-46d2-bee4-91009d56335b service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:00.314396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5e1b-8cc1-46d2-bee4-91009d56335b service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:00.318265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c940eca-6751-4dd9-a2de-53452c7c4b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:00.318790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940eca-6751-4dd9-a2de-53452c7c4b37 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:00.319072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940eca-6751-4dd9-a2de-53452c7c4b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:00.319349 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940eca-6751-4dd9-a2de-53452c7c4b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:00.321828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1c940eca-6751-4dd9-a2de-53452c7c4b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:00.332393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c940eca-6751-4dd9-a2de-53452c7c4b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:00.335574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c940eca-6751-4dd9-a2de-53452c7c4b37 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:00.342142 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1326/2662] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:07.272612 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:10.338511 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=9 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:12.443135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136182d-4243-4006-8667-a7fbbcc5f430 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:12.443643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136182d-4243-4006-8667-a7fbbcc5f430 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:12.443643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136182d-4243-4006-8667-a7fbbcc5f430 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:12.445031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1337/2663] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:13:12.450372 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e02e-34cc-4369-af79-32b828d0b397 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:12.450760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e02e-34cc-4369-af79-32b828d0b397 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:12.450953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e02e-34cc-4369-af79-32b828d0b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:12.470085 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7e30e02e-34cc-4369-af79-32b828d0b397 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:12.471328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7e30e02e-34cc-4369-af79-32b828d0b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:12.534647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1327/2664] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:13:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:12.555208 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136182d-4243-4006-8667-a7fbbcc5f430 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:12.557549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a136182d-4243-4006-8667-a7fbbcc5f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:12.574222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136182d-4243-4006-8667-a7fbbcc5f430 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:12.579249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77ea27-754a-4bea-b320-6a19ae690cb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:12.579890 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77ea27-754a-4bea-b320-6a19ae690cb3 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:12.580183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77ea27-754a-4bea-b320-6a19ae690cb3 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:12.580467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77ea27-754a-4bea-b320-6a19ae690cb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:12.589150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77ea27-754a-4bea-b320-6a19ae690cb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:12.590750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77ea27-754a-4bea-b320-6a19ae690cb3 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:12.600406 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1338/2665] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:22.525832 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=29 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:22.596403 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:42.370710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51262bf-0f9a-428d-bbaa-2a1d9e30fc87 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:42.371277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51262bf-0f9a-428d-bbaa-2a1d9e30fc87 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:42.371277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51262bf-0f9a-428d-bbaa-2a1d9e30fc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:42.389055 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a51262bf-0f9a-428d-bbaa-2a1d9e30fc87 None None] MFA Rules not processed for user `356997615725481eaf8c64cef99d9b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:42.390287 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a51262bf-0f9a-428d-bbaa-2a1d9e30fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:42.397550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1328/2666] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:13:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:42.647144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77ea27-754a-4bea-b320-6a19ae690cb3 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:42.657240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77ea27-754a-4bea-b320-6a19ae690cb3 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:42.660932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:42.661576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:42.661866 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:42.662185 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:42.664016 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:42.674745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:42.676234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:42.684651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1339/2667] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:43.079944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51262bf-0f9a-428d-bbaa-2a1d9e30fc87 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:43.093343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51262bf-0f9a-428d-bbaa-2a1d9e30fc87 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:43.099655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:43.101831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:43.101831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:43.101831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:43.102922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:43.117220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:43.118824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:43.129856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1329/2668] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:13:44.722049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:44.737065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad2b07-247a-4875-8db3-e90b059a1de1 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:44.743341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db7f9f-0d86-4938-8e0d-d6b88e6fcdcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:44.744115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db7f9f-0d86-4938-8e0d-d6b88e6fcdcf service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:44.744473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db7f9f-0d86-4938-8e0d-d6b88e6fcdcf service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:44.744855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db7f9f-0d86-4938-8e0d-d6b88e6fcdcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:44.746943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f9db7f9f-0d86-4938-8e0d-d6b88e6fcdcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:44.761230 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db7f9f-0d86-4938-8e0d-d6b88e6fcdcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:44.762211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db7f9f-0d86-4938-8e0d-d6b88e6fcdcf service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:44.774258 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1340/2669] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:52.675487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:52.677764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:52.698948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b5c23-c823-43b7-9fc8-92ac19c5e6bb service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:52.705854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325427f0-322d-4fe9-8f19-f92150a0df87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:52.706535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325427f0-322d-4fe9-8f19-f92150a0df87 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:52.706814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325427f0-322d-4fe9-8f19-f92150a0df87 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:52.707088 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325427f0-322d-4fe9-8f19-f92150a0df87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:52.713517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-325427f0-322d-4fe9-8f19-f92150a0df87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:52.727197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325427f0-322d-4fe9-8f19-f92150a0df87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:52.728879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325427f0-322d-4fe9-8f19-f92150a0df87 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:52.746223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1330/2670] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:54.769278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=12 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:56.061520 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ded6-c994-4505-ad3f-166ee468e68d None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.069539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ded6-c994-4505-ad3f-166ee468e68d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.069539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ded6-c994-4505-ad3f-166ee468e68d None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.069539 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1341/2671] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:13:56.069814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a079f-0fff-47af-ad7f-0357c983b16d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.069814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a079f-0fff-47af-ad7f-0357c983b16d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.069814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a079f-0fff-47af-ad7f-0357c983b16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.099237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-734a079f-0fff-47af-ad7f-0357c983b16d None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:56.100477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-734a079f-0fff-47af-ad7f-0357c983b16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:56.110155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1331/2672] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:56.131025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637ded6-c994-4505-ad3f-166ee468e68d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:56.146124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637ded6-c994-4505-ad3f-166ee468e68d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:56.151118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada6aa8-8ada-4da3-bad3-338b1bb8a5a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:56.151757 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada6aa8-8ada-4da3-bad3-338b1bb8a5a0 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.152040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada6aa8-8ada-4da3-bad3-338b1bb8a5a0 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.152318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada6aa8-8ada-4da3-bad3-338b1bb8a5a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.161183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada6aa8-8ada-4da3-bad3-338b1bb8a5a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:56.162774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada6aa8-8ada-4da3-bad3-338b1bb8a5a0 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:56.172945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1342/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:14:06.094437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=22 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:06.168354 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:46.873665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a079f-0fff-47af-ad7f-0357c983b16d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.882046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a079f-0fff-47af-ad7f-0357c983b16d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.886622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.887500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.887785 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.888059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] PATH_INFO: `/v3/users/356997615725481eaf8c64cef99d9b4e` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.889245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] RBAC: Authorizing `identity:delete_user(user_id=356997615725481eaf8c64cef99d9b4e)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.891250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.049159 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356997615725481eaf8c64cef99d9b4e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.103946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356997615725481eaf8c64cef99d9b4e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.117084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356997615725481eaf8c64cef99d9b4e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.117724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356997615725481eaf8c64cef99d9b4e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.124974 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-d46572a6-b698-4487-99fe-9d7b2e54770c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356997615725481eaf8c64cef99d9b4e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.131596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1332/2674] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:46 2022] DELETE /identity/v3/users/356997615725481eaf8c64cef99d9b4e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:47.351554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada6aa8-8ada-4da3-bad3-338b1bb8a5a0 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.363382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada6aa8-8ada-4da3-bad3-338b1bb8a5a0 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.423628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.424491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.424773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.425051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] PATH_INFO: `/v3/projects/07af555a10a543f0b733b5af94d8eb12` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.426278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07af555a10a543f0b733b5af94d8eb12)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.428166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.527643 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07af555a10a543f0b733b5af94d8eb12', 'request_id': 'req-162f6b2b-a439-473f-a025-5d0c31504483'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.572661 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07af555a10a543f0b733b5af94d8eb12', 'request_id': 'req-162f6b2b-a439-473f-a025-5d0c31504483'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.579117 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07af555a10a543f0b733b5af94d8eb12', 'request_id': 'req-162f6b2b-a439-473f-a025-5d0c31504483'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.589357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] The token cache is being invalidate because project 07af555a10a543f0b733b5af94d8eb12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:47.589644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.590309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-162f6b2b-a439-473f-a025-5d0c31504483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.591847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1343/2675] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:47 2022] DELETE /identity/v3/projects/07af555a10a543f0b733b5af94d8eb12 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:47.596765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ab4f-a600-4dc0-8b93-bc754db3cd18 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.597075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ab4f-a600-4dc0-8b93-bc754db3cd18 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.597332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ab4f-a600-4dc0-8b93-bc754db3cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.617661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4357ab4f-a600-4dc0-8b93-bc754db3cd18 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:47.618918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4357ab4f-a600-4dc0-8b93-bc754db3cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:47.677493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1333/2676] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:47.685205 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59830d-6b54-4ba6-b67c-fabc7f179376 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.685496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59830d-6b54-4ba6-b67c-fabc7f179376 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.685778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59830d-6b54-4ba6-b67c-fabc7f179376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.704374 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-ef59830d-6b54-4ba6-b67c-fabc7f179376 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:47.705565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ef59830d-6b54-4ba6-b67c-fabc7f179376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:47.713476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1344/2677] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:47.717480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ab4f-a600-4dc0-8b93-bc754db3cd18 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.727126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ab4f-a600-4dc0-8b93-bc754db3cd18 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.731712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.732359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.732905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.733180 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.733899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:47.734243 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.736328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.748020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1334/2678] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:47.752794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59830d-6b54-4ba6-b67c-fabc7f179376 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.762049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59830d-6b54-4ba6-b67c-fabc7f179376 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.766647 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907c92-d3a7-4646-b96a-9deb59d97cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.767292 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907c92-d3a7-4646-b96a-9deb59d97cab admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.767580 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907c92-d3a7-4646-b96a-9deb59d97cab admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.767858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907c92-d3a7-4646-b96a-9deb59d97cab admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.768568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3907c92-d3a7-4646-b96a-9deb59d97cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.770474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3907c92-d3a7-4646-b96a-9deb59d97cab admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.866509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1345/2679] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:47 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:47.870845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.881035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fc852-3845-4796-8067-15db90e023c6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.937761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c6ca-caa1-41cc-885d-81eb7653b246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.938486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c6ca-caa1-41cc-885d-81eb7653b246 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.938768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c6ca-caa1-41cc-885d-81eb7653b246 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.939040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c6ca-caa1-41cc-885d-81eb7653b246 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.939719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59c6ca-caa1-41cc-885d-81eb7653b246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.941673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59c6ca-caa1-41cc-885d-81eb7653b246 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.948174 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:47.990532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1335/2680] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:47 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:47.994763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907c92-d3a7-4646-b96a-9deb59d97cab admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.005080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907c92-d3a7-4646-b96a-9deb59d97cab admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.009731 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a7cd9-9052-4076-a826-9ba2a493dded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.010483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7cd9-9052-4076-a826-9ba2a493dded admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.010773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7cd9-9052-4076-a826-9ba2a493dded admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.011068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7cd9-9052-4076-a826-9ba2a493dded admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.011810 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a7cd9-9052-4076-a826-9ba2a493dded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.013404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a7cd9-9052-4076-a826-9ba2a493dded admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.024092 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1346/2681] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:48.028152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c6ca-caa1-41cc-885d-81eb7653b246 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.038789 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c6ca-caa1-41cc-885d-81eb7653b246 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.043830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137555a-13e1-494b-a28a-a81488fe976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.044491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137555a-13e1-494b-a28a-a81488fe976f admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.044774 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137555a-13e1-494b-a28a-a81488fe976f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.045052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137555a-13e1-494b-a28a-a81488fe976f admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.045777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137555a-13e1-494b-a28a-a81488fe976f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.047455 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137555a-13e1-494b-a28a-a81488fe976f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.058087 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1336/2682] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:48.062366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a7cd9-9052-4076-a826-9ba2a493dded admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.072391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a7cd9-9052-4076-a826-9ba2a493dded admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.077046 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.077927 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.078262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.078548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] PATH_INFO: `/v3/projects/4ff1cc8c7dab44f189aa8f6411ea92e0/users/cb56f2effb4e4d129318ca4bc57f2c42/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.093000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff1cc8c7dab44f189aa8f6411ea92e0, user_id=cb56f2effb4e4d129318ca4bc57f2c42, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.096212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.174564 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1347/2683] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:48 2022] PUT /identity/v3/projects/4ff1cc8c7dab44f189aa8f6411ea92e0/users/cb56f2effb4e4d129318ca4bc57f2c42/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:48.179700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7b50-c149-4ac9-bfa8-6d3453507936 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.179993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7b50-c149-4ac9-bfa8-6d3453507936 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.180273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7b50-c149-4ac9-bfa8-6d3453507936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.197993 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-05ba7b50-c149-4ac9-bfa8-6d3453507936 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:48.199273 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-05ba7b50-c149-4ac9-bfa8-6d3453507936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:48.257913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1337/2684] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:14:48.268118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.269826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:48.300669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:48.326530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3206f6a-dd32-4daa-94f1-7577280a6812 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.330771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.331471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.331769 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.332270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.342130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.343719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.354086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1348/2685] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:53.094031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c80d-b455-4d1f-a702-4ca614617830 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:53.094706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c80d-b455-4d1f-a702-4ca614617830 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:53.094796 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c80d-b455-4d1f-a702-4ca614617830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:53.123721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7d85c80d-b455-4d1f-a702-4ca614617830 None None] MFA Rules not processed for user `cb56f2effb4e4d129318ca4bc57f2c42`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:53.124899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7d85c80d-b455-4d1f-a702-4ca614617830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:53.204615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1338/2686] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:14:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:53.224151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:53.225830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:53.312855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cae41-46fd-47b1-87bb-222b9cdb431c service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:53.322430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbcd41-3edf-42fb-8d9d-1b1a0896ecd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:53.323120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbcd41-3edf-42fb-8d9d-1b1a0896ecd8 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:53.323413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbcd41-3edf-42fb-8d9d-1b1a0896ecd8 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:53.323693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbcd41-3edf-42fb-8d9d-1b1a0896ecd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:53.334715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbcd41-3edf-42fb-8d9d-1b1a0896ecd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:53.336037 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbcd41-3edf-42fb-8d9d-1b1a0896ecd8 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:53.346285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1349/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:55.765097 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bddcf-17bd-4cff-a293-31937367ae88 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:55.765637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bddcf-17bd-4cff-a293-31937367ae88 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:55.765637 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bddcf-17bd-4cff-a293-31937367ae88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:55.786031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7c2bddcf-17bd-4cff-a293-31937367ae88 None None] MFA Rules not processed for user `cb56f2effb4e4d129318ca4bc57f2c42`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:55.787363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7c2bddcf-17bd-4cff-a293-31937367ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:55.815562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1339/2688] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:14:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:03.341527 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=48 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:05.779648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:42.270113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58398-a1fa-43a0-ae74-db56965f9d5b None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:42.270671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58398-a1fa-43a0-ae74-db56965f9d5b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:42.270671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58398-a1fa-43a0-ae74-db56965f9d5b None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:42.272085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1350/2689] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:15:42.276671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b1f5-b247-442d-b7cd-3e1bb28627e3 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:42.277116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b1f5-b247-442d-b7cd-3e1bb28627e3 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:42.277217 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b1f5-b247-442d-b7cd-3e1bb28627e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:42.295952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d1f6b1f5-b247-442d-b7cd-3e1bb28627e3 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:42.297210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d1f6b1f5-b247-442d-b7cd-3e1bb28627e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:42.361182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1340/2690] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:15:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:42.381300 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b58398-a1fa-43a0-ae74-db56965f9d5b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:42.383058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a2b58398-a1fa-43a0-ae74-db56965f9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:42.400226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b58398-a1fa-43a0-ae74-db56965f9d5b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:42.405462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed26d-279c-4ed2-8a04-b486f3b5dfd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:42.406131 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed26d-279c-4ed2-8a04-b486f3b5dfd5 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:42.406492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed26d-279c-4ed2-8a04-b486f3b5dfd5 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:42.406774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed26d-279c-4ed2-8a04-b486f3b5dfd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:42.416009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed26d-279c-4ed2-8a04-b486f3b5dfd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:42.417611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed26d-279c-4ed2-8a04-b486f3b5dfd5 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:42.427460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1351/2691] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:52.352393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=29 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:52.423426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:14.895116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342f78-9164-4e2f-b596-075f5adee79a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:14.895663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342f78-9164-4e2f-b596-075f5adee79a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:14.895663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342f78-9164-4e2f-b596-075f5adee79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:14.913777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-e0342f78-9164-4e2f-b596-075f5adee79a None None] MFA Rules not processed for user `cb56f2effb4e4d129318ca4bc57f2c42`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:14.915031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e0342f78-9164-4e2f-b596-075f5adee79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:14.922076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1341/2692] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:16:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:24.908554 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:26.916055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed26d-279c-4ed2-8a04-b486f3b5dfd5 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:26.927592 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed26d-279c-4ed2-8a04-b486f3b5dfd5 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:26.933544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f30dd0-d26a-44e9-bd0a-0470fe58c854 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:26.934236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30dd0-d26a-44e9-bd0a-0470fe58c854 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:26.934528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30dd0-d26a-44e9-bd0a-0470fe58c854 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:26.934861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30dd0-d26a-44e9-bd0a-0470fe58c854 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:26.936773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-39f30dd0-d26a-44e9-bd0a-0470fe58c854 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:26.950648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f30dd0-d26a-44e9-bd0a-0470fe58c854 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:26.952380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f30dd0-d26a-44e9-bd0a-0470fe58c854 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:26.964034 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1352/2693] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:36.958390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:18.402363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342f78-9164-4e2f-b596-075f5adee79a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:18.413007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342f78-9164-4e2f-b596-075f5adee79a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:18.416719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3675e-313d-4311-87c0-8c08ae524f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:18.417365 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3675e-313d-4311-87c0-8c08ae524f39 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.420134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3675e-313d-4311-87c0-8c08ae524f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.420134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3675e-313d-4311-87c0-8c08ae524f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.420134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c5d3675e-313d-4311-87c0-8c08ae524f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:18.429417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3675e-313d-4311-87c0-8c08ae524f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:18.430879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3675e-313d-4311-87c0-8c08ae524f39 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:18.438899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1342/2694] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:18.575973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8660e6-623f-4f2f-b03f-4749ea107313 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.576524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8660e6-623f-4f2f-b03f-4749ea107313 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.576524 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8660e6-623f-4f2f-b03f-4749ea107313 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.578053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1353/2695] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:17:18.582984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a533a-5d12-4b41-8a24-0b3761043135 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.583367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a533a-5d12-4b41-8a24-0b3761043135 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.583651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a533a-5d12-4b41-8a24-0b3761043135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.603069 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-019a533a-5d12-4b41-8a24-0b3761043135 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:18.604285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-019a533a-5d12-4b41-8a24-0b3761043135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:18.613166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1343/2696] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:17:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:17:18.634359 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8660e6-623f-4f2f-b03f-4749ea107313 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:18.647962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8660e6-623f-4f2f-b03f-4749ea107313 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:18.652935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d887a8-85d8-4545-b9bd-b3bab48366f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:18.653573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d887a8-85d8-4545-b9bd-b3bab48366f1 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.653861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d887a8-85d8-4545-b9bd-b3bab48366f1 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.654181 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d887a8-85d8-4545-b9bd-b3bab48366f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.662554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d887a8-85d8-4545-b9bd-b3bab48366f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:18.664130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d887a8-85d8-4545-b9bd-b3bab48366f1 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:18.674118 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1354/2697] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:18.944889 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a533a-5d12-4b41-8a24-0b3761043135 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:18.954899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a533a-5d12-4b41-8a24-0b3761043135 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:18.958541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:18.959921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.960218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.960493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.962376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:18.976137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:18.977563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:18.989375 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1344/2698] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:28.669812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:28.984317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=15 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:37.602974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22bdd-7fcd-41e0-a098-b95fc2a82c0e None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:37.603414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22bdd-7fcd-41e0-a098-b95fc2a82c0e None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:37.603503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22bdd-7fcd-41e0-a098-b95fc2a82c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:37.621145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-39b22bdd-7fcd-41e0-a098-b95fc2a82c0e None None] MFA Rules not processed for user `cb56f2effb4e4d129318ca4bc57f2c42`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:37.622389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-39b22bdd-7fcd-41e0-a098-b95fc2a82c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:37.629268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1355/2699] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:17:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:37.925636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:37.934801 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37bbd6-855e-40a5-b562-4300c38cb221 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:37.938396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:37.939028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:37.939308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:37.939582 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:37.941317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:37.951498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:37.952902 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:37.962134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1345/2700] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:45.179745 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22bdd-7fcd-41e0-a098-b95fc2a82c0e None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:45.189500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22bdd-7fcd-41e0-a098-b95fc2a82c0e None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:45.193109 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:45.193749 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:45.194038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:45.194366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:45.196133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:45.209924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:45.211379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:45.223196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1356/2701] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:47.957702 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:51.073825 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:51.075436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:51.091905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1585e-a8e2-43ce-93b4-5ea96751f777 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:51.097634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02780863-d6d4-4f4c-928b-afcde5d11505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:51.098313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780863-d6d4-4f4c-928b-afcde5d11505 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:51.098597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780863-d6d4-4f4c-928b-afcde5d11505 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:51.098873 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780863-d6d4-4f4c-928b-afcde5d11505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:51.100703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-02780863-d6d4-4f4c-928b-afcde5d11505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:51.113629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02780863-d6d4-4f4c-928b-afcde5d11505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:51.115466 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02780863-d6d4-4f4c-928b-afcde5d11505 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:51.126317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1346/2702] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:55.218215 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=9 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:01.121802 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:24.317646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:24.319260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:24.330836 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bfdeb-413a-4af6-8e08-f2e5788c8a90 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:24.334544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3e0bb-5bfc-4c4c-8a06-466a1d62af02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:24.337693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3e0bb-5bfc-4c4c-8a06-466a1d62af02 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:24.337693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3e0bb-5bfc-4c4c-8a06-466a1d62af02 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:24.337693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3e0bb-5bfc-4c4c-8a06-466a1d62af02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:24.337693 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0dc3e0bb-5bfc-4c4c-8a06-466a1d62af02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:24.352167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3e0bb-5bfc-4c4c-8a06-466a1d62af02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:24.353583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3e0bb-5bfc-4c4c-8a06-466a1d62af02 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:24.364975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1357/2703] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:24.594138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f333f-7674-4910-b4b2-a18bb7e8ca83 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:24.594743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f333f-7674-4910-b4b2-a18bb7e8ca83 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:24.594858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f333f-7674-4910-b4b2-a18bb7e8ca83 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:24.596236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1347/2704] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:18:24.600962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970649e9-f67a-481f-a4eb-4e6748c31049 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:24.601314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970649e9-f67a-481f-a4eb-4e6748c31049 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:24.601600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970649e9-f67a-481f-a4eb-4e6748c31049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:24.619898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-970649e9-f67a-481f-a4eb-4e6748c31049 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:24.621094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-970649e9-f67a-481f-a4eb-4e6748c31049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:24.630136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1358/2705] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:18:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:24.651426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f333f-7674-4910-b4b2-a18bb7e8ca83 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:24.664842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f333f-7674-4910-b4b2-a18bb7e8ca83 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:24.669647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e741-4f59-490f-a351-b11a1bdda413 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:24.670295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e741-4f59-490f-a351-b11a1bdda413 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:24.670578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e741-4f59-490f-a351-b11a1bdda413 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:24.670849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e741-4f59-490f-a351-b11a1bdda413 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:24.679492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e741-4f59-490f-a351-b11a1bdda413 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:24.681072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e741-4f59-490f-a351-b11a1bdda413 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:24.691548 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1348/2706] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:25.146347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970649e9-f67a-481f-a4eb-4e6748c31049 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:25.156167 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970649e9-f67a-481f-a4eb-4e6748c31049 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:25.159863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:25.160512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:25.160804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:25.161086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:25.162992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:25.172709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:25.174193 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:25.182389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1359/2707] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:34.687580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:35.178664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=15 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:56.215309 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e741-4f59-490f-a351-b11a1bdda413 service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:56.229039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e741-4f59-490f-a351-b11a1bdda413 service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:56.235181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3833a-2476-4b3b-a9f0-3347170a57a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:56.235934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3833a-2476-4b3b-a9f0-3347170a57a5 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:56.236223 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3833a-2476-4b3b-a9f0-3347170a57a5 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:56.236529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3833a-2476-4b3b-a9f0-3347170a57a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:56.238377 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-54c3833a-2476-4b3b-a9f0-3347170a57a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:56.263276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3833a-2476-4b3b-a9f0-3347170a57a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:56.265589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3833a-2476-4b3b-a9f0-3347170a57a5 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:56.277241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1349/2708] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:00.850770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:00.865099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5814a-ff58-4b1b-afb0-246a3565210a service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:00.870818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:00.871489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:00.871748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:00.872025 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:00.874325 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:00.886795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:00.888383 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:00.899974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1360/2709] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:02.488275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9e20-3596-41c3-866e-198a62188aed None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:02.488779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9e20-3596-41c3-866e-198a62188aed None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:02.488961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9e20-3596-41c3-866e-198a62188aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:02.507089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-158b9e20-3596-41c3-866e-198a62188aed None None] MFA Rules not processed for user `cb56f2effb4e4d129318ca4bc57f2c42`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:02.508277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-158b9e20-3596-41c3-866e-198a62188aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:02.515205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1350/2710] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:19:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:02.815139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:02.824348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6062139-3005-40ac-855e-6a991c05ada6 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:02.828795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:02.829418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:02.829701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:02.829978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:02.831774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:02.841125 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:02.842991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:02.850636 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1361/2711] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:03.231864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9e20-3596-41c3-866e-198a62188aed None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:03.233862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-158b9e20-3596-41c3-866e-198a62188aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:03.249838 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9e20-3596-41c3-866e-198a62188aed None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:03.254986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dffe3-f625-4cf5-9fd5-c99605e5c7d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:03.255640 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dffe3-f625-4cf5-9fd5-c99605e5c7d6 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:03.255929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dffe3-f625-4cf5-9fd5-c99605e5c7d6 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:03.256203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dffe3-f625-4cf5-9fd5-c99605e5c7d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:03.258017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7b7dffe3-f625-4cf5-9fd5-c99605e5c7d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:03.278239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dffe3-f625-4cf5-9fd5-c99605e5c7d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:03.278239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dffe3-f625-4cf5-9fd5-c99605e5c7d6 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:03.284665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1351/2712] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:12.846992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=12 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:13.279556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=19 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:53.770213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:53.771748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:53.851671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fcd9a-cdf2-4ecc-aa2a-18c2199eacad service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:53.855699 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fac0c-d7db-4b6f-a272-fa1b3902295b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a80e224da849e19538182793f13e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:53.856641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fac0c-d7db-4b6f-a272-fa1b3902295b service cinder] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:53.856641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fac0c-d7db-4b6f-a272-fa1b3902295b service cinder] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:53.858990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fac0c-d7db-4b6f-a272-fa1b3902295b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:53.866422 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fac0c-d7db-4b6f-a272-fa1b3902295b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:53.867917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fac0c-d7db-4b6f-a272-fa1b3902295b service cinder] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:53.877739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1362/2713] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:03.872809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=35 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:05.116041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6aea1-e82b-4b29-8b5e-5642d6418338 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:05.116623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6aea1-e82b-4b29-8b5e-5642d6418338 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:05.116623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6aea1-e82b-4b29-8b5e-5642d6418338 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:05.118048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1352/2714] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:20:05.123852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409cc7-cda8-4a71-af56-0983f5c6ae53 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:05.124314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409cc7-cda8-4a71-af56-0983f5c6ae53 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:05.124602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409cc7-cda8-4a71-af56-0983f5c6ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:05.144388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-82409cc7-cda8-4a71-af56-0983f5c6ae53 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:05.145621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-82409cc7-cda8-4a71-af56-0983f5c6ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:05.195051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1363/2715] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:20:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:05.216471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6aea1-e82b-4b29-8b5e-5642d6418338 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:05.231136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6aea1-e82b-4b29-8b5e-5642d6418338 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:05.236050 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38561794-e15a-4d82-b8bc-b566336174ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:05.236688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38561794-e15a-4d82-b8bc-b566336174ff service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:05.236970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38561794-e15a-4d82-b8bc-b566336174ff service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:05.237245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38561794-e15a-4d82-b8bc-b566336174ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:05.245744 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38561794-e15a-4d82-b8bc-b566336174ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:05.247380 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38561794-e15a-4d82-b8bc-b566336174ff service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:05.257759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1353/2716] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:15.192838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=21 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:15.253534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:12.064241 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82409cc7-cda8-4a71-af56-0983f5c6ae53 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:12.083229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82409cc7-cda8-4a71-af56-0983f5c6ae53 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:12.086845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceea71-ee67-41f8-a36d-d23e8baf2b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:12.087480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceea71-ee67-41f8-a36d-d23e8baf2b26 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:12.087765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceea71-ee67-41f8-a36d-d23e8baf2b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:12.088043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceea71-ee67-41f8-a36d-d23e8baf2b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:12.097148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceea71-ee67-41f8-a36d-d23e8baf2b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:12.099298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceea71-ee67-41f8-a36d-d23e8baf2b26 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:12.109885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1364/2717] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:15.232329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38561794-e15a-4d82-b8bc-b566336174ff service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:15.243384 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38561794-e15a-4d82-b8bc-b566336174ff service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:15.248445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:15.249089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:15.249376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:15.249658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:15.251509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:15.263622 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:15.265225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:15.276430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1354/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:15.333356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceea71-ee67-41f8-a36d-d23e8baf2b26 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:15.362542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceea71-ee67-41f8-a36d-d23e8baf2b26 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:15.367319 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:15.368224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:15.368516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:15.368801 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] PATH_INFO: `/v3/users/cb56f2effb4e4d129318ca4bc57f2c42` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:15.370002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb56f2effb4e4d129318ca4bc57f2c42)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:15.371954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:15.534557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb56f2effb4e4d129318ca4bc57f2c42'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:15.616722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb56f2effb4e4d129318ca4bc57f2c42'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:15.629067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb56f2effb4e4d129318ca4bc57f2c42'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:15.636332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb56f2effb4e4d129318ca4bc57f2c42'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:15.636969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-90c82d73-cfd2-45b4-9bb9-dd295a65c673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb56f2effb4e4d129318ca4bc57f2c42'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:15.642919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1365/2719] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:15 2022] DELETE /identity/v3/users/cb56f2effb4e4d129318ca4bc57f2c42 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:15.899197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:15.914331 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d75151-19ef-408e-bac7-ce98c23a87c1 service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:15.970694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:15.971544 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:15.971828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:15.972103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] PATH_INFO: `/v3/projects/4ff1cc8c7dab44f189aa8f6411ea92e0` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:15.973276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff1cc8c7dab44f189aa8f6411ea92e0)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:15.975210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:16.060983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff1cc8c7dab44f189aa8f6411ea92e0', 'request_id': 'req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:16.120727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff1cc8c7dab44f189aa8f6411ea92e0', 'request_id': 'req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:16.127033 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff1cc8c7dab44f189aa8f6411ea92e0', 'request_id': 'req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:16.153277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] The token cache is being invalidate because project 4ff1cc8c7dab44f189aa8f6411ea92e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:16.155098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:16.155098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f42c24a1-be39-4643-a9cd-d9f6c3044b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:16.155853 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1355/2720] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:15 2022] DELETE /identity/v3/projects/4ff1cc8c7dab44f189aa8f6411ea92e0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:16.160859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc9a6-62d5-4fb2-8871-15445a0c0e2a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.161137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc9a6-62d5-4fb2-8871-15445a0c0e2a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.161435 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc9a6-62d5-4fb2-8871-15445a0c0e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.188411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-580fc9a6-62d5-4fb2-8871-15445a0c0e2a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:16.189626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-580fc9a6-62d5-4fb2-8871-15445a0c0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:16.250705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1366/2721] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:16.259236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35753ec-568f-4af4-ad85-337f70a3cf8a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.261949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35753ec-568f-4af4-ad85-337f70a3cf8a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.261949 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35753ec-568f-4af4-ad85-337f70a3cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.278631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d35753ec-568f-4af4-ad85-337f70a3cf8a None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:16.279846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d35753ec-568f-4af4-ad85-337f70a3cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:16.287729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1356/2722] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:16.291945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fc9a6-62d5-4fb2-8871-15445a0c0e2a None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:16.301684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fc9a6-62d5-4fb2-8871-15445a0c0e2a None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:16.306252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:16.306900 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.307190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.307463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.308182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:21:16.308488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:16.310056 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:16.321885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1367/2723] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:21:16.326082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35753ec-568f-4af4-ad85-337f70a3cf8a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:16.335945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35753ec-568f-4af4-ad85-337f70a3cf8a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:16.340734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2064-d907-4bc0-be5b-a35b1d142f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:16.341385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2064-d907-4bc0-be5b-a35b1d142f98 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.341670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2064-d907-4bc0-be5b-a35b1d142f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.341947 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2064-d907-4bc0-be5b-a35b1d142f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.342694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2064-d907-4bc0-be5b-a35b1d142f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:16.344591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2064-d907-4bc0-be5b-a35b1d142f98 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:16.436697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1357/2724] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:16 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:16.440710 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:16.451852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b11f4-f318-415c-9abf-a3dac23a0954 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:16.464216 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:16.509526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6653088-0caf-4fc7-8e9a-1e26652182cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:16.510255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653088-0caf-4fc7-8e9a-1e26652182cb admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.510544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653088-0caf-4fc7-8e9a-1e26652182cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.510819 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653088-0caf-4fc7-8e9a-1e26652182cb admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.511514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6653088-0caf-4fc7-8e9a-1e26652182cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:16.513425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6653088-0caf-4fc7-8e9a-1e26652182cb admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:16.611793 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1368/2725] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:16 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:21:16.615899 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2064-d907-4bc0-be5b-a35b1d142f98 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:16.626337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2064-d907-4bc0-be5b-a35b1d142f98 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:16.630941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9541-f34a-4fe5-b13b-91a897440892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:16.631597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9541-f34a-4fe5-b13b-91a897440892 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.631877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9541-f34a-4fe5-b13b-91a897440892 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.632148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9541-f34a-4fe5-b13b-91a897440892 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.632858 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f9541-f34a-4fe5-b13b-91a897440892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:16.634487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f9541-f34a-4fe5-b13b-91a897440892 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:16.645520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1358/2726] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:16.649370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6653088-0caf-4fc7-8e9a-1e26652182cb admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:16.659326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6653088-0caf-4fc7-8e9a-1e26652182cb admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:16.664562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6704d-fa51-4225-bb31-03fe79c118f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:16.665214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6704d-fa51-4225-bb31-03fe79c118f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.665501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6704d-fa51-4225-bb31-03fe79c118f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.665780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6704d-fa51-4225-bb31-03fe79c118f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.666537 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6704d-fa51-4225-bb31-03fe79c118f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:16.668115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6704d-fa51-4225-bb31-03fe79c118f2 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:16.678035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1369/2727] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:16.682184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9541-f34a-4fe5-b13b-91a897440892 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:16.692116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9541-f34a-4fe5-b13b-91a897440892 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:16.696739 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:16.697604 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.697886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.698189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] PATH_INFO: `/v3/projects/3eee6dd21cef415db27de5a3dee64dba/users/1c53bbb537a747e3a24d86011be18e73/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.713134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eee6dd21cef415db27de5a3dee64dba, user_id=1c53bbb537a747e3a24d86011be18e73, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:16.715821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:16.783706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1359/2728] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:16 2022] PUT /identity/v3/projects/3eee6dd21cef415db27de5a3dee64dba/users/1c53bbb537a747e3a24d86011be18e73/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:16.789338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741abaf-68f3-48a7-80bb-d1a0d7dd76bd None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.789670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741abaf-68f3-48a7-80bb-d1a0d7dd76bd None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.793513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741abaf-68f3-48a7-80bb-d1a0d7dd76bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.807759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b741abaf-68f3-48a7-80bb-d1a0d7dd76bd None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:16.808974 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b741abaf-68f3-48a7-80bb-d1a0d7dd76bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:16.867079 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1370/2729] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:16.876539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:16.878259 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:16.882064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:16.947581 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a658c-5072-42d7-a814-8255972a5381 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:16.951246 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4234017-d0d3-4be8-8fc8-b0469fe052b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:16.951886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4234017-d0d3-4be8-8fc8-b0469fe052b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:16.952166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4234017-d0d3-4be8-8fc8-b0469fe052b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:16.952454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4234017-d0d3-4be8-8fc8-b0469fe052b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:16.962118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4234017-d0d3-4be8-8fc8-b0469fe052b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:16.963555 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4234017-d0d3-4be8-8fc8-b0469fe052b2 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:16.973447 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1360/2730] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:22.559933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2cf0c-2296-4cf9-b8c3-2a07ec64e396 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:22.560460 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2cf0c-2296-4cf9-b8c3-2a07ec64e396 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:22.560583 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2cf0c-2296-4cf9-b8c3-2a07ec64e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:22.589194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-89d2cf0c-2296-4cf9-b8c3-2a07ec64e396 None None] MFA Rules not processed for user `1c53bbb537a747e3a24d86011be18e73`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:22.590450 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-89d2cf0c-2296-4cf9-b8c3-2a07ec64e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:22.657134 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1371/2731] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:21:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:22.667475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed38d8-215d-4c5d-9559-9152aa4ee768 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:22.667931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed38d8-215d-4c5d-9559-9152aa4ee768 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:22.668025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed38d8-215d-4c5d-9559-9152aa4ee768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:22.685298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-17ed38d8-215d-4c5d-9559-9152aa4ee768 None None] MFA Rules not processed for user `1c53bbb537a747e3a24d86011be18e73`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:22.686547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-17ed38d8-215d-4c5d-9559-9152aa4ee768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:22.693491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1361/2732] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:21:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:22.706459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2cf0c-2296-4cf9-b8c3-2a07ec64e396 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:22.708348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-89d2cf0c-2296-4cf9-b8c3-2a07ec64e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:22.737657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:22.783458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2cf0c-2296-4cf9-b8c3-2a07ec64e396 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:22.789783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef25b7-5ce9-467d-a4a2-952ac895b156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:22.790606 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef25b7-5ce9-467d-a4a2-952ac895b156 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:22.790892 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef25b7-5ce9-467d-a4a2-952ac895b156 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:22.791175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef25b7-5ce9-467d-a4a2-952ac895b156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:22.800408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef25b7-5ce9-467d-a4a2-952ac895b156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:22.802734 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef25b7-5ce9-467d-a4a2-952ac895b156 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:22.812550 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1372/2733] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:30.355948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed38d8-215d-4c5d-9559-9152aa4ee768 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:30.357360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-17ed38d8-215d-4c5d-9559-9152aa4ee768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:30.455711 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed38d8-215d-4c5d-9559-9152aa4ee768 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:30.462121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:30.462921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:30.463277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:30.463638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:30.465664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:30.479297 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:30.480906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:30.495509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1362/2734] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:32.828756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=23 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:35.313941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa8de8-9ac7-4417-945e-737162962ca1 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:35.314629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa8de8-9ac7-4417-945e-737162962ca1 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:35.314629 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa8de8-9ac7-4417-945e-737162962ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:35.335006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-eefa8de8-9ac7-4417-945e-737162962ca1 None None] MFA Rules not processed for user `1c53bbb537a747e3a24d86011be18e73`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:35.336369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-eefa8de8-9ac7-4417-945e-737162962ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:35.343698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1373/2735] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:40.487229 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=74 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:45.329733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:01.646499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:01.662257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cb11f-42a2-49ef-b8c4-e0678ab42fd1 service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:01.667221 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:01.668107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:01.668404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:01.668714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] PATH_INFO: `/v3/users/1c53bbb537a747e3a24d86011be18e73` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:01.670755 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c53bbb537a747e3a24d86011be18e73)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:01.677841 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:01.940938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c53bbb537a747e3a24d86011be18e73'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.011464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c53bbb537a747e3a24d86011be18e73'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.025765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c53bbb537a747e3a24d86011be18e73'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.026655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c53bbb537a747e3a24d86011be18e73'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.034188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-35257788-a75a-46d1-bed7-6c19066a1ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c53bbb537a747e3a24d86011be18e73'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.040235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1363/2736] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:01 2022] DELETE /identity/v3/users/1c53bbb537a747e3a24d86011be18e73 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:02.279696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa8de8-9ac7-4417-945e-737162962ca1 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:02.291039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa8de8-9ac7-4417-945e-737162962ca1 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:02.353476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:02.354369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:02.354674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:02.354934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] PATH_INFO: `/v3/projects/3eee6dd21cef415db27de5a3dee64dba` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:02.356663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eee6dd21cef415db27de5a3dee64dba)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:02.358602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:02.499231 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eee6dd21cef415db27de5a3dee64dba', 'request_id': 'req-ec70f364-7654-4abb-9453-9a2df0e9eac0'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.617427 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eee6dd21cef415db27de5a3dee64dba', 'request_id': 'req-ec70f364-7654-4abb-9453-9a2df0e9eac0'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.624519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eee6dd21cef415db27de5a3dee64dba', 'request_id': 'req-ec70f364-7654-4abb-9453-9a2df0e9eac0'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.635323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] The token cache is being invalidate because project 3eee6dd21cef415db27de5a3dee64dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:02.635640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.636286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ec70f364-7654-4abb-9453-9a2df0e9eac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:02.638608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1374/2737] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:02 2022] DELETE /identity/v3/projects/3eee6dd21cef415db27de5a3dee64dba => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:02.643862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799e3c-5c36-4487-aa71-6e29fbc8363f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:02.644147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799e3c-5c36-4487-aa71-6e29fbc8363f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:02.644420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799e3c-5c36-4487-aa71-6e29fbc8363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:02.698608 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-73799e3c-5c36-4487-aa71-6e29fbc8363f None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:02.700343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-73799e3c-5c36-4487-aa71-6e29fbc8363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:02.765979 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1364/2738] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:02.773800 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac91f2-3ca4-4ef6-9337-23b48f433bde None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:02.774094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac91f2-3ca4-4ef6-9337-23b48f433bde None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:02.774410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac91f2-3ca4-4ef6-9337-23b48f433bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:02.793312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4fac91f2-3ca4-4ef6-9337-23b48f433bde None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:02.794625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4fac91f2-3ca4-4ef6-9337-23b48f433bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:02.803028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1375/2739] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:02.807322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73799e3c-5c36-4487-aa71-6e29fbc8363f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:02.817124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73799e3c-5c36-4487-aa71-6e29fbc8363f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:02.821701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:02.822400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:02.822687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:02.822962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:02.823689 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:02.823995 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:02.826145 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:02.837842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1365/2740] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:02.842838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac91f2-3ca4-4ef6-9337-23b48f433bde None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:02.852771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac91f2-3ca4-4ef6-9337-23b48f433bde None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:02.859280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0b1a7-6859-49f4-a6e0-a19dd2863b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:02.859958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b1a7-6859-49f4-a6e0-a19dd2863b27 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:02.860247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b1a7-6859-49f4-a6e0-a19dd2863b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:02.860536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b1a7-6859-49f4-a6e0-a19dd2863b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:02.861251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0b1a7-6859-49f4-a6e0-a19dd2863b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:02.863221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0b1a7-6859-49f4-a6e0-a19dd2863b27 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:02.968522 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1376/2741] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:02 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:02.972738 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:02.983651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1be025-bbfd-48b4-b01e-bb5452afb0d4 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:03.018567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:03.048294 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ba0ed-a535-4155-819f-ddab5d836728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:03.048967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ba0ed-a535-4155-819f-ddab5d836728 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:03.049255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ba0ed-a535-4155-819f-ddab5d836728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:03.049628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ba0ed-a535-4155-819f-ddab5d836728 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:03.050376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ba0ed-a535-4155-819f-ddab5d836728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:03.052361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ba0ed-a535-4155-819f-ddab5d836728 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:03.188691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1366/2742] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:02 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:03.193680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0b1a7-6859-49f4-a6e0-a19dd2863b27 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:03.207504 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0b1a7-6859-49f4-a6e0-a19dd2863b27 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:03.212301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf736dc-e205-486a-bce2-1787e9d797d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:03.212972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf736dc-e205-486a-bce2-1787e9d797d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:03.213264 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf736dc-e205-486a-bce2-1787e9d797d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:03.213547 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf736dc-e205-486a-bce2-1787e9d797d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:03.214318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf736dc-e205-486a-bce2-1787e9d797d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:03.216424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf736dc-e205-486a-bce2-1787e9d797d3 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:03.231687 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1377/2743] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:03.234531 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ba0ed-a535-4155-819f-ddab5d836728 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:03.244756 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ba0ed-a535-4155-819f-ddab5d836728 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:03.249433 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22ef3c-7221-4ee9-8739-1d04c93f9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:03.250115 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22ef3c-7221-4ee9-8739-1d04c93f9342 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:03.250418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22ef3c-7221-4ee9-8739-1d04c93f9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:03.250696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22ef3c-7221-4ee9-8739-1d04c93f9342 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:03.251428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22ef3c-7221-4ee9-8739-1d04c93f9342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:03.253016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22ef3c-7221-4ee9-8739-1d04c93f9342 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:03.263572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1367/2744] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:03.275729 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf736dc-e205-486a-bce2-1787e9d797d3 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:03.287172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf736dc-e205-486a-bce2-1787e9d797d3 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:03.292538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:03.293462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:03.293753 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:03.294039 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] PATH_INFO: `/v3/projects/b41b487b9e334b56a526b6fb98b26cf1/users/860cf32842214d26a5ab7e05c35a2604/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:03.309981 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41b487b9e334b56a526b6fb98b26cf1, user_id=860cf32842214d26a5ab7e05c35a2604, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:03.313040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:03.395608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1378/2745] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:03 2022] PUT /identity/v3/projects/b41b487b9e334b56a526b6fb98b26cf1/users/860cf32842214d26a5ab7e05c35a2604/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:03.406746 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8eb20-4203-491c-b427-17c9350239f6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:03.407034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8eb20-4203-491c-b427-17c9350239f6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:03.407310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8eb20-4203-491c-b427-17c9350239f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:03.434127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-82e8eb20-4203-491c-b427-17c9350239f6 None None] MFA Rules not processed for user `860cf32842214d26a5ab7e05c35a2604`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:03.435363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-82e8eb20-4203-491c-b427-17c9350239f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:03.501868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1368/2746] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:03.512439 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:03.514240 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:03.536724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:03.577491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e27e50-c9f7-4633-885d-71dbd434530b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:03.581191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66276016-ef3d-44ed-a15c-5ac9521f2b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:03.581868 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276016-ef3d-44ed-a15c-5ac9521f2b43 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:03.582565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276016-ef3d-44ed-a15c-5ac9521f2b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:03.583018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276016-ef3d-44ed-a15c-5ac9521f2b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:03.593184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66276016-ef3d-44ed-a15c-5ac9521f2b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:03.594950 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66276016-ef3d-44ed-a15c-5ac9521f2b43 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:03.605560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1379/2747] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:10.235945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8eb20-4203-491c-b427-17c9350239f6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:10.237631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-82e8eb20-4203-491c-b427-17c9350239f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:10.320210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8eb20-4203-491c-b427-17c9350239f6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:10.326763 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef44d-5e64-406c-8c52-516a70c5ff1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:10.326990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef44d-5e64-406c-8c52-516a70c5ff1d service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:10.327220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef44d-5e64-406c-8c52-516a70c5ff1d service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:10.327482 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef44d-5e64-406c-8c52-516a70c5ff1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:10.329627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0dcef44d-5e64-406c-8c52-516a70c5ff1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:10.346731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcef44d-5e64-406c-8c52-516a70c5ff1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:10.348459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcef44d-5e64-406c-8c52-516a70c5ff1d service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:10.360676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1369/2748] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:13.707723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=18 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:20.355141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:20.980906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66276016-ef3d-44ed-a15c-5ac9521f2b43 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:21.046400 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66276016-ef3d-44ed-a15c-5ac9521f2b43 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:21.051012 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:21.051961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:21.052213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:21.052493 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] PATH_INFO: `/v3/users/860cf32842214d26a5ab7e05c35a2604` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:21.053688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860cf32842214d26a5ab7e05c35a2604)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:21.055689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:21.224505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860cf32842214d26a5ab7e05c35a2604'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.290897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860cf32842214d26a5ab7e05c35a2604'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.303318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860cf32842214d26a5ab7e05c35a2604'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.310095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860cf32842214d26a5ab7e05c35a2604'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.310768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860cf32842214d26a5ab7e05c35a2604'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.316902 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1380/2749] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:20 2022] DELETE /identity/v3/users/860cf32842214d26a5ab7e05c35a2604 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:21.321535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d84f4-ba93-4a8b-862e-cd8a8397a350 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:21.321820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d84f4-ba93-4a8b-862e-cd8a8397a350 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:21.322092 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d84f4-ba93-4a8b-862e-cd8a8397a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:21.340107 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-067d84f4-ba93-4a8b-862e-cd8a8397a350 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:21.341860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-067d84f4-ba93-4a8b-862e-cd8a8397a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:21.399699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1370/2750] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:21.411091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:21.412486 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:21.470010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19481728-139a-4f42-b1cd-6c5524f977c9 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:21.473917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de020cc-7196-4436-9142-5a7609209c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:21.474658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de020cc-7196-4436-9142-5a7609209c53 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:21.474895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de020cc-7196-4436-9142-5a7609209c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:21.475180 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de020cc-7196-4436-9142-5a7609209c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:21.484654 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de020cc-7196-4436-9142-5a7609209c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:21.486083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de020cc-7196-4436-9142-5a7609209c53 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:21.496256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1381/2751] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:21.761239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d84f4-ba93-4a8b-862e-cd8a8397a350 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:21.763776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-067d84f4-ba93-4a8b-862e-cd8a8397a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:21.775203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d84f4-ba93-4a8b-862e-cd8a8397a350 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:21.779772 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:21.780639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:21.780919 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:21.781193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] PATH_INFO: `/v3/projects/b41b487b9e334b56a526b6fb98b26cf1` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:21.782403 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41b487b9e334b56a526b6fb98b26cf1)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:21.784308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:21.885762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41b487b9e334b56a526b6fb98b26cf1', 'request_id': 'req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.959543 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41b487b9e334b56a526b6fb98b26cf1', 'request_id': 'req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.966347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41b487b9e334b56a526b6fb98b26cf1', 'request_id': 'req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.979195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] The token cache is being invalidate because project b41b487b9e334b56a526b6fb98b26cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:21.979484 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.980112 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-76776e11-8ea3-4937-9c2c-a5d8f7d484b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.981638 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1371/2752] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:21 2022] DELETE /identity/v3/projects/b41b487b9e334b56a526b6fb98b26cf1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:21.987112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213692-9584-4dd1-a7f4-dca9f82e4020 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:21.987594 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213692-9584-4dd1-a7f4-dca9f82e4020 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:21.987717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213692-9584-4dd1-a7f4-dca9f82e4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.005324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-3c213692-9584-4dd1-a7f4-dca9f82e4020 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:22.006512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3c213692-9584-4dd1-a7f4-dca9f82e4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:22.023912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:22.067489 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1382/2753] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:22.075837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fbae-a6e4-44c3-b1c1-690263a300db None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.076121 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fbae-a6e4-44c3-b1c1-690263a300db None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.076396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fbae-a6e4-44c3-b1c1-690263a300db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.095376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-a285fbae-a6e4-44c3-b1c1-690263a300db None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:22.096577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a285fbae-a6e4-44c3-b1c1-690263a300db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:22.104703 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1372/2754] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:22.108988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c213692-9584-4dd1-a7f4-dca9f82e4020 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:22.118785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c213692-9584-4dd1-a7f4-dca9f82e4020 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:22.123464 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:22.124119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.124410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.124691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.125414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:22.125728 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:22.127387 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:22.139596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1383/2755] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:22.143687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285fbae-a6e4-44c3-b1c1-690263a300db None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:22.152766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285fbae-a6e4-44c3-b1c1-690263a300db None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:22.157872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e177698-dffe-4ae0-aa69-14511c07c2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:22.158552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177698-dffe-4ae0-aa69-14511c07c2dd admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.158833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177698-dffe-4ae0-aa69-14511c07c2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.159105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177698-dffe-4ae0-aa69-14511c07c2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.159780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e177698-dffe-4ae0-aa69-14511c07c2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:22.161705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e177698-dffe-4ae0-aa69-14511c07c2dd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:22.245307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1373/2756] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:22 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:22.249476 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:22.259474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4325fbc-c213-436f-8489-a72d69b12a2e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:22.315229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3ab9-fd21-4187-afda-df3fbfa00656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:22.315897 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3ab9-fd21-4187-afda-df3fbfa00656 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.316181 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3ab9-fd21-4187-afda-df3fbfa00656 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.316461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3ab9-fd21-4187-afda-df3fbfa00656 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.317145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3ab9-fd21-4187-afda-df3fbfa00656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:22.319077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3ab9-fd21-4187-afda-df3fbfa00656 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:22.394074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1384/2757] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:22 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:22.398332 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e177698-dffe-4ae0-aa69-14511c07c2dd admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:22.408795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e177698-dffe-4ae0-aa69-14511c07c2dd admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:22.413476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f370be2-0aef-4386-af13-f90ac9216d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:22.414151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f370be2-0aef-4386-af13-f90ac9216d42 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.414436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f370be2-0aef-4386-af13-f90ac9216d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.414712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f370be2-0aef-4386-af13-f90ac9216d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.415430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f370be2-0aef-4386-af13-f90ac9216d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:22.417014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f370be2-0aef-4386-af13-f90ac9216d42 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:22.427420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1374/2758] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:22.431336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3ab9-fd21-4187-afda-df3fbfa00656 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:22.442049 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3ab9-fd21-4187-afda-df3fbfa00656 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:22.447212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43750c04-5080-42c8-9a25-438f4afeca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:22.447903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750c04-5080-42c8-9a25-438f4afeca87 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.448219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750c04-5080-42c8-9a25-438f4afeca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.448507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750c04-5080-42c8-9a25-438f4afeca87 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.449232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43750c04-5080-42c8-9a25-438f4afeca87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:22.451478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43750c04-5080-42c8-9a25-438f4afeca87 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:22.461577 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1385/2759] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:22.465846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f370be2-0aef-4386-af13-f90ac9216d42 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:22.477337 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f370be2-0aef-4386-af13-f90ac9216d42 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:22.483251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:22.484126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.484409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.484686 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] PATH_INFO: `/v3/projects/2b31f659f9bd475fac15349b037b2923/users/f9ef0a877055443986e0a271ccf8eb8c/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.501173 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b31f659f9bd475fac15349b037b2923, user_id=f9ef0a877055443986e0a271ccf8eb8c, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:22.503924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:22.616144 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1375/2760] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:22 2022] PUT /identity/v3/projects/2b31f659f9bd475fac15349b037b2923/users/f9ef0a877055443986e0a271ccf8eb8c/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:22.627135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f20663-b07b-4dee-b421-5835eda846ee None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.627426 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f20663-b07b-4dee-b421-5835eda846ee None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.627727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f20663-b07b-4dee-b421-5835eda846ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.655412 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b8f20663-b07b-4dee-b421-5835eda846ee None None] MFA Rules not processed for user `f9ef0a877055443986e0a271ccf8eb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:22.656646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b8f20663-b07b-4dee-b421-5835eda846ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:22.722399 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1386/2761] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:22.732961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:22.734725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:22.759166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:22.794416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6db7dc-6317-4fcf-9632-99a350e48183 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:22.798651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c656d48-69eb-4d9c-b4a0-38c9510e2257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:22.799290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c656d48-69eb-4d9c-b4a0-38c9510e2257 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.799568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c656d48-69eb-4d9c-b4a0-38c9510e2257 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.799839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c656d48-69eb-4d9c-b4a0-38c9510e2257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.815835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c656d48-69eb-4d9c-b4a0-38c9510e2257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:22.818141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c656d48-69eb-4d9c-b4a0-38c9510e2257 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:22.828096 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1376/2762] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:28.645099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f20663-b07b-4dee-b421-5835eda846ee None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:28.664853 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:28.708641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f20663-b07b-4dee-b421-5835eda846ee None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:28.713674 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:28.716066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:28.716066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:28.716066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] PATH_INFO: `/v3/users/f9ef0a877055443986e0a271ccf8eb8c` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:28.716556 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ef0a877055443986e0a271ccf8eb8c)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:28.718523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:28.887099 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ef0a877055443986e0a271ccf8eb8c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:28.953842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ef0a877055443986e0a271ccf8eb8c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:28.966748 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ef0a877055443986e0a271ccf8eb8c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:28.973662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ef0a877055443986e0a271ccf8eb8c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:28.974459 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ef0a877055443986e0a271ccf8eb8c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:28.980709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1387/2763] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:28 2022] DELETE /identity/v3/users/f9ef0a877055443986e0a271ccf8eb8c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:28.986034 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69118-a32f-4c77-a226-6e919219224d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:28.986613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69118-a32f-4c77-a226-6e919219224d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:28.986613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69118-a32f-4c77-a226-6e919219224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:29.004508 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-02a69118-a32f-4c77-a226-6e919219224d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:29.005713 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-02a69118-a32f-4c77-a226-6e919219224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:29.069992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1377/2764] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:29.079671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:29.081075 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:29.144666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e2de1-ea47-4cd9-9506-88d752e7447b admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:29.148429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78dcd6-3b07-4c91-8374-8f2580df1d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:29.149086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78dcd6-3b07-4c91-8374-8f2580df1d2f service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:29.149375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78dcd6-3b07-4c91-8374-8f2580df1d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:29.149849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78dcd6-3b07-4c91-8374-8f2580df1d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:29.160417 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78dcd6-3b07-4c91-8374-8f2580df1d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:29.162013 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78dcd6-3b07-4c91-8374-8f2580df1d2f service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:29.172627 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1388/2765] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:29.418260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69118-a32f-4c77-a226-6e919219224d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:29.419915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-02a69118-a32f-4c77-a226-6e919219224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:29.433368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69118-a32f-4c77-a226-6e919219224d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:29.438699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:29.439596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:29.439875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:29.440645 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] PATH_INFO: `/v3/projects/2b31f659f9bd475fac15349b037b2923` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:29.441960 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b31f659f9bd475fac15349b037b2923)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:29.443948 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:29.579333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b31f659f9bd475fac15349b037b2923', 'request_id': 'req-ba717d6c-5a14-42e9-837e-abe74ca634f3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:29.638929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b31f659f9bd475fac15349b037b2923', 'request_id': 'req-ba717d6c-5a14-42e9-837e-abe74ca634f3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:29.645073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b31f659f9bd475fac15349b037b2923', 'request_id': 'req-ba717d6c-5a14-42e9-837e-abe74ca634f3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:29.657400 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] The token cache is being invalidate because project 2b31f659f9bd475fac15349b037b2923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:29.657709 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:29.658376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-ba717d6c-5a14-42e9-837e-abe74ca634f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:29.660027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1378/2766] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:29 2022] DELETE /identity/v3/projects/2b31f659f9bd475fac15349b037b2923 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:29.665245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31de65-e545-4474-b442-a920bf393a19 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:29.665726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31de65-e545-4474-b442-a920bf393a19 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:29.665726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31de65-e545-4474-b442-a920bf393a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:29.685357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-7e31de65-e545-4474-b442-a920bf393a19 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:29.686624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7e31de65-e545-4474-b442-a920bf393a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:29.720418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:29.749347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1389/2767] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:29.757166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71be82-f471-4ddd-8636-d626431dda0c None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:29.757462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71be82-f471-4ddd-8636-d626431dda0c None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:29.757741 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71be82-f471-4ddd-8636-d626431dda0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:29.781089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-dc71be82-f471-4ddd-8636-d626431dda0c None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:29.782347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-dc71be82-f471-4ddd-8636-d626431dda0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:29.790302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1379/2768] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:29.794615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31de65-e545-4474-b442-a920bf393a19 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:29.804402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31de65-e545-4474-b442-a920bf393a19 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:29.809115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:29.810478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:29.810988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:29.811597 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:29.812328 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:29.812642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:29.814273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:29.826605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1390/2769] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:29.831149 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71be82-f471-4ddd-8636-d626431dda0c None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:29.841632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71be82-f471-4ddd-8636-d626431dda0c None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:29.846307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f9fd-b87f-47a9-88f8-417fea322cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:29.846955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f9fd-b87f-47a9-88f8-417fea322cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:29.847261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f9fd-b87f-47a9-88f8-417fea322cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:29.847535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f9fd-b87f-47a9-88f8-417fea322cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:29.848275 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f9fd-b87f-47a9-88f8-417fea322cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:29.850324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f9fd-b87f-47a9-88f8-417fea322cb9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:29.932646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1380/2770] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:29 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:29.938123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:29.948763 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef796-ff42-48fb-b1fc-6a668e72f14f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:30.011336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2143-5946-4dfa-8127-a284097d0060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:30.011336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2143-5946-4dfa-8127-a284097d0060 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:30.011336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2143-5946-4dfa-8127-a284097d0060 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:30.011336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2143-5946-4dfa-8127-a284097d0060 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:30.012530 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2143-5946-4dfa-8127-a284097d0060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:30.013444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2143-5946-4dfa-8127-a284097d0060 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:30.085632 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1391/2771] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:29 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:30.089683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f9fd-b87f-47a9-88f8-417fea322cb9 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:30.100926 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f9fd-b87f-47a9-88f8-417fea322cb9 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:30.105928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ea9a-c32e-425d-af04-fa0f0c0a345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:30.107253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ea9a-c32e-425d-af04-fa0f0c0a345b admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:30.107539 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ea9a-c32e-425d-af04-fa0f0c0a345b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:30.107821 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ea9a-c32e-425d-af04-fa0f0c0a345b admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:30.108551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ea9a-c32e-425d-af04-fa0f0c0a345b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:30.110182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ea9a-c32e-425d-af04-fa0f0c0a345b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:30.120933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1381/2772] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:30.125305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2143-5946-4dfa-8127-a284097d0060 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:30.135502 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2143-5946-4dfa-8127-a284097d0060 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:30.140201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4914f5c-e4aa-470f-842c-c00d9c4c2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:30.140861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914f5c-e4aa-470f-842c-c00d9c4c2a00 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:30.141154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914f5c-e4aa-470f-842c-c00d9c4c2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:30.141430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914f5c-e4aa-470f-842c-c00d9c4c2a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:30.142196 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4914f5c-e4aa-470f-842c-c00d9c4c2a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:30.143791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4914f5c-e4aa-470f-842c-c00d9c4c2a00 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:30.154512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1392/2773] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:30.158725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ea9a-c32e-425d-af04-fa0f0c0a345b admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:30.169986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ea9a-c32e-425d-af04-fa0f0c0a345b admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:30.174647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:30.175513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:30.175798 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:30.176070 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] PATH_INFO: `/v3/projects/98012bf2dfd04c4face8d2695ace4d69/users/40627c2bb7ab413cbb2eefc056a13ae3/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:30.178351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:30.192547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98012bf2dfd04c4face8d2695ace4d69, user_id=40627c2bb7ab413cbb2eefc056a13ae3, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:30.195184 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:30.245944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1382/2774] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:30 2022] PUT /identity/v3/projects/98012bf2dfd04c4face8d2695ace4d69/users/40627c2bb7ab413cbb2eefc056a13ae3/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:30.251177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b9e4-06b7-40ad-9e49-9c6eabab73be None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:30.251478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b9e4-06b7-40ad-9e49-9c6eabab73be None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:30.251766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b9e4-06b7-40ad-9e49-9c6eabab73be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:30.270260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1920b9e4-06b7-40ad-9e49-9c6eabab73be None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:30.273434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1920b9e4-06b7-40ad-9e49-9c6eabab73be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:30.331474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1393/2775] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:30.341728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:30.343452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:30.404108 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29668c-90be-4a1c-b295-4eff776ef78f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:30.407794 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3e91c-e210-4fee-bf89-aa0811065185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:30.408437 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3e91c-e210-4fee-bf89-aa0811065185 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:30.408724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3e91c-e210-4fee-bf89-aa0811065185 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:30.409003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3e91c-e210-4fee-bf89-aa0811065185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:30.418035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3e91c-e210-4fee-bf89-aa0811065185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:30.419522 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3e91c-e210-4fee-bf89-aa0811065185 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:30.429081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1383/2776] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:35.678147 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75474ea-78b5-4739-83bb-140c4810514d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:35.678641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75474ea-78b5-4739-83bb-140c4810514d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:35.680111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75474ea-78b5-4739-83bb-140c4810514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:35.712270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f75474ea-78b5-4739-83bb-140c4810514d None None] MFA Rules not processed for user `40627c2bb7ab413cbb2eefc056a13ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:35.713509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f75474ea-78b5-4739-83bb-140c4810514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:35.763280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:35.802030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3e91c-e210-4fee-bf89-aa0811065185 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:35.806210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1394/2777] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:35.812903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3e91c-e210-4fee-bf89-aa0811065185 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:35.817730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0bce-305c-4ead-bab3-5d71d2c9b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:35.818442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0bce-305c-4ead-bab3-5d71d2c9b01c admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:35.818726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0bce-305c-4ead-bab3-5d71d2c9b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:35.819005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0bce-305c-4ead-bab3-5d71d2c9b01c admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:35.819704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff0bce-305c-4ead-bab3-5d71d2c9b01c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:35.821612 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff0bce-305c-4ead-bab3-5d71d2c9b01c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:35.904834 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1384/2778] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:35 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:35.909058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75474ea-78b5-4739-83bb-140c4810514d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:35.920434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75474ea-78b5-4739-83bb-140c4810514d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:35.990838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459fe96-b57c-44ea-9bbe-f47a1c137773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:35.991542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459fe96-b57c-44ea-9bbe-f47a1c137773 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:35.991834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459fe96-b57c-44ea-9bbe-f47a1c137773 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:35.992120 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459fe96-b57c-44ea-9bbe-f47a1c137773 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:35.992839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459fe96-b57c-44ea-9bbe-f47a1c137773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:35.994843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459fe96-b57c-44ea-9bbe-f47a1c137773 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:36.086139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1395/2779] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:35 2022] POST /identity/v3/users => generated 301 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:36.090343 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0bce-305c-4ead-bab3-5d71d2c9b01c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:36.109804 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0bce-305c-4ead-bab3-5d71d2c9b01c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:36.126898 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94609076-780a-4679-893a-aaf3dc284f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:36.127665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94609076-780a-4679-893a-aaf3dc284f0d admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:36.127973 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94609076-780a-4679-893a-aaf3dc284f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:36.128282 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94609076-780a-4679-893a-aaf3dc284f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:36.130161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94609076-780a-4679-893a-aaf3dc284f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:36.131716 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94609076-780a-4679-893a-aaf3dc284f0d admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:36.147201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1385/2780] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:36.151404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459fe96-b57c-44ea-9bbe-f47a1c137773 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:36.161977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459fe96-b57c-44ea-9bbe-f47a1c137773 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:36.167536 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447127-0d1d-49db-b2a1-a680ce364f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:36.171928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447127-0d1d-49db-b2a1-a680ce364f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:36.171928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447127-0d1d-49db-b2a1-a680ce364f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:36.171928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447127-0d1d-49db-b2a1-a680ce364f1c admin admin] PATH_INFO: `/v3/projects/80818d45b3b64475972c5000882e11be/users/324eb326a409452cb7c6d0e3292b2934/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:36.187888 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5447127-0d1d-49db-b2a1-a680ce364f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80818d45b3b64475972c5000882e11be, user_id=324eb326a409452cb7c6d0e3292b2934, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:36.190837 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5447127-0d1d-49db-b2a1-a680ce364f1c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:36.307910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1396/2781] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:36 2022] PUT /identity/v3/projects/80818d45b3b64475972c5000882e11be/users/324eb326a409452cb7c6d0e3292b2934/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:36.312487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94609076-780a-4679-893a-aaf3dc284f0d admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:36.323197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94609076-780a-4679-893a-aaf3dc284f0d admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:36.385388 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927b3ec-cd13-47ee-ba1c-2732465739c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:36.386071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927b3ec-cd13-47ee-ba1c-2732465739c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:36.386394 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927b3ec-cd13-47ee-ba1c-2732465739c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:36.386676 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927b3ec-cd13-47ee-ba1c-2732465739c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:36.387444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927b3ec-cd13-47ee-ba1c-2732465739c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:36.389103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927b3ec-cd13-47ee-ba1c-2732465739c9 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:36.399872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1386/2782] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:36.404111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447127-0d1d-49db-b2a1-a680ce364f1c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:36.415214 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447127-0d1d-49db-b2a1-a680ce364f1c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:36.420665 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:36.421631 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:36.422044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:36.422365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] PATH_INFO: `/v3/projects/80818d45b3b64475972c5000882e11be/users/324eb326a409452cb7c6d0e3292b2934/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:36.424454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80818d45b3b64475972c5000882e11be, user_id=324eb326a409452cb7c6d0e3292b2934, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:36.427356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:36.438954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1397/2783] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:36 2022] PUT /identity/v3/projects/80818d45b3b64475972c5000882e11be/users/324eb326a409452cb7c6d0e3292b2934/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:41.964373 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a01a0-29cb-4116-a13f-0174389d46af None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.964893 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a01a0-29cb-4116-a13f-0174389d46af None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.964991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a01a0-29cb-4116-a13f-0174389d46af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.998315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-685a01a0-29cb-4116-a13f-0174389d46af None None] MFA Rules not processed for user `324eb326a409452cb7c6d0e3292b2934`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:41.999666 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-685a01a0-29cb-4116-a13f-0174389d46af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:42.049392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:42.083886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1387/2784] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:42.099356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:42.101273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:42.186889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67a17-bd17-4f17-a790-dd9a184a615c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:42.192720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:42.193391 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:42.193678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:42.193962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:42.221364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:42.255863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:42.257478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:42.267932 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1398/2785] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:42.458790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fac31-dce3-49b9-a643-86ac77dad54d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:42.459078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fac31-dce3-49b9-a643-86ac77dad54d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:42.465202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fac31-dce3-49b9-a643-86ac77dad54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:42.479220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-455fac31-dce3-49b9-a643-86ac77dad54d None None] MFA Rules not processed for user `40627c2bb7ab413cbb2eefc056a13ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:42.480498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-455fac31-dce3-49b9-a643-86ac77dad54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:42.493862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1388/2786] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:45.451162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.452682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.526408 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69686-8e68-46d9-89a2-4941d872a17e service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.530626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c54ce-8d08-4dbb-9c2d-81a91177777b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.531263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c54ce-8d08-4dbb-9c2d-81a91177777b service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.531585 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c54ce-8d08-4dbb-9c2d-81a91177777b service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.531912 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c54ce-8d08-4dbb-9c2d-81a91177777b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.533857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-223c54ce-8d08-4dbb-9c2d-81a91177777b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.610781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c54ce-8d08-4dbb-9c2d-81a91177777b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.616783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c54ce-8d08-4dbb-9c2d-81a91177777b service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.647234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1399/2787] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:52.472717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=15 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:55.419293 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fac31-dce3-49b9-a643-86ac77dad54d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:55.421434 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-455fac31-dce3-49b9-a643-86ac77dad54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:55.481134 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fac31-dce3-49b9-a643-86ac77dad54d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:55.485449 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28b3a-304d-4142-b84f-c2abdb16f3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a80e224da849e19538182793f13e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:55.486123 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28b3a-304d-4142-b84f-c2abdb16f3df service cinder] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:55.486413 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28b3a-304d-4142-b84f-c2abdb16f3df service cinder] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:55.486691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28b3a-304d-4142-b84f-c2abdb16f3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:55.496326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d28b3a-304d-4142-b84f-c2abdb16f3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:55.498509 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d28b3a-304d-4142-b84f-c2abdb16f3df service cinder] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:55.507542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1389/2788] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:55.641933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=54 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:05.503152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=26 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:25.299686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed157ac-0b28-4562-9e46-bbdd3908ac2a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:25.302210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed157ac-0b28-4562-9e46-bbdd3908ac2a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:25.302210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed157ac-0b28-4562-9e46-bbdd3908ac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:25.317777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1ed157ac-0b28-4562-9e46-bbdd3908ac2a None None] MFA Rules not processed for user `40627c2bb7ab413cbb2eefc056a13ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:25.319069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1ed157ac-0b28-4562-9e46-bbdd3908ac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:25.326148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1400/2789] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:25.575715 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28b3a-304d-4142-b84f-c2abdb16f3df service cinder] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:25.585461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28b3a-304d-4142-b84f-c2abdb16f3df service cinder] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:25.589052 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:25.589688 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:25.589970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:25.590285 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:25.592047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:25.602580 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:25.604011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:25.612972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1390/2790] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:26.009768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed157ac-0b28-4562-9e46-bbdd3908ac2a None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:26.020151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed157ac-0b28-4562-9e46-bbdd3908ac2a None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:26.023951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:26.024596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:26.024904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:26.025182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:26.026983 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:26.041218 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:26.042720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:26.054475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1401/2791] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:28.757023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:28.768360 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f41a41-ea2a-4405-8c02-580fbe1716f4 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:28.771464 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:28.772347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.772636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.772918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.774933 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:28.786078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:28.787557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:28.796491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1391/2792] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:36.049700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=9 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:38.793196 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=12 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:05.197407 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:05.198827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:05.212483 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ce9e-797f-4e7b-9a8e-be0098ff52a4 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:05.217975 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:05.218642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:05.218929 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:05.219209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:05.220933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:05.233714 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:05.235306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:05.246590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1402/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:13.661717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:13.726527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3fd15-ebda-4798-ad62-45b9e488dbaa service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:13.731304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:13.732164 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:13.732448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:13.732726 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] PATH_INFO: `/v3/users/40627c2bb7ab413cbb2eefc056a13ae3` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:13.733912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40627c2bb7ab413cbb2eefc056a13ae3)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:13.735852 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:13.908053 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40627c2bb7ab413cbb2eefc056a13ae3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:13.986446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40627c2bb7ab413cbb2eefc056a13ae3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:13.999816 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40627c2bb7ab413cbb2eefc056a13ae3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.000442 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40627c2bb7ab413cbb2eefc056a13ae3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.008017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40627c2bb7ab413cbb2eefc056a13ae3'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.013920 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1392/2794] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:24:13 2022] DELETE /identity/v3/users/40627c2bb7ab413cbb2eefc056a13ae3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:14.262124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:14.273358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a8723-a3ed-4e66-ad70-8ef92b7ee540 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:14.336201 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:14.337086 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:14.337375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:14.337659 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] PATH_INFO: `/v3/projects/98012bf2dfd04c4face8d2695ace4d69` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:14.338977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98012bf2dfd04c4face8d2695ace4d69)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:14.340898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:14.466838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98012bf2dfd04c4face8d2695ace4d69', 'request_id': 'req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.535187 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98012bf2dfd04c4face8d2695ace4d69', 'request_id': 'req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.543175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98012bf2dfd04c4face8d2695ace4d69', 'request_id': 'req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.554404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] The token cache is being invalidate because project 98012bf2dfd04c4face8d2695ace4d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:24:14.554846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.555348 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.557042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1403/2795] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:24:14 2022] DELETE /identity/v3/projects/98012bf2dfd04c4face8d2695ace4d69 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:14.561059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:14.562765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:14.576627 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025f74-3c7f-4b61-9e9b-1447d9ebc58f admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:14.633625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:14.634547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:14.634857 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:14.635136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] PATH_INFO: `/v3/users/324eb326a409452cb7c6d0e3292b2934` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:14.636327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=324eb326a409452cb7c6d0e3292b2934)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:14.638303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:14.659714 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:14.806138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324eb326a409452cb7c6d0e3292b2934'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.883038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324eb326a409452cb7c6d0e3292b2934'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.895500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324eb326a409452cb7c6d0e3292b2934'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.896161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324eb326a409452cb7c6d0e3292b2934'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.903010 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-5c632453-1d8b-47f9-a347-802fe398ab3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324eb326a409452cb7c6d0e3292b2934'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:14.908892 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1393/2796] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:24:14 2022] DELETE /identity/v3/users/324eb326a409452cb7c6d0e3292b2934 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:15.153032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:15.154528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:15.174415 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62a55d-a0cf-4843-babd-e2f0eb7a686c admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:15.231817 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:15.232675 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:15.232959 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:15.233239 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] PATH_INFO: `/v3/projects/80818d45b3b64475972c5000882e11be` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:15.234471 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=80818d45b3b64475972c5000882e11be)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:15.236392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:15.257951 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:15.335768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80818d45b3b64475972c5000882e11be', 'request_id': 'req-102d2e68-cfc2-4847-860a-673d0d077fae'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:15.431094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80818d45b3b64475972c5000882e11be', 'request_id': 'req-102d2e68-cfc2-4847-860a-673d0d077fae'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:15.437827 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80818d45b3b64475972c5000882e11be', 'request_id': 'req-102d2e68-cfc2-4847-860a-673d0d077fae'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:15.448499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] The token cache is being invalidate because project 80818d45b3b64475972c5000882e11be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:24:15.448792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:15.449448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-102d2e68-cfc2-4847-860a-673d0d077fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:15.451066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1404/2797] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:24:15 2022] DELETE /identity/v3/projects/80818d45b3b64475972c5000882e11be => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:15.456176 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcc14-2470-478e-8a2e-981a19b9339e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:15.456471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcc14-2470-478e-8a2e-981a19b9339e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:15.456752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcc14-2470-478e-8a2e-981a19b9339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:15.476086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7f9fcc14-2470-478e-8a2e-981a19b9339e None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:15.477570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7f9fcc14-2470-478e-8a2e-981a19b9339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:15.536137 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1394/2798] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:15.546540 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c966-69f1-47bf-816b-5d440e2ac297 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:15.546838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c966-69f1-47bf-816b-5d440e2ac297 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:15.547127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c966-69f1-47bf-816b-5d440e2ac297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:15.566055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-bce1c966-69f1-47bf-816b-5d440e2ac297 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:15.567297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bce1c966-69f1-47bf-816b-5d440e2ac297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:15.575448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1405/2799] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:15.579842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcc14-2470-478e-8a2e-981a19b9339e None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:15.590395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcc14-2470-478e-8a2e-981a19b9339e None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:15.594983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:15.595626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:15.595906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:15.596178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:15.596896 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:24:15.597225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:15.598845 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:15.611151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1395/2800] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:24:15.615405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1c966-69f1-47bf-816b-5d440e2ac297 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:15.624625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1c966-69f1-47bf-816b-5d440e2ac297 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:15.629312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b2e6-d161-40bd-b502-655086545e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:15.629939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b2e6-d161-40bd-b502-655086545e6e admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:15.630262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b2e6-d161-40bd-b502-655086545e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:15.630545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b2e6-d161-40bd-b502-655086545e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:15.631261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9b2e6-d161-40bd-b502-655086545e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:15.633140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9b2e6-d161-40bd-b502-655086545e6e admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:15.742891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1406/2801] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:24:15 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:15.747139 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:15.757501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac888a-bfb0-45f6-a645-978534b03fc2 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:15.813561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0686d7e-f063-496f-90d3-a02dd52ac10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:15.814266 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0686d7e-f063-496f-90d3-a02dd52ac10c admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:15.814530 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0686d7e-f063-496f-90d3-a02dd52ac10c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:15.814806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0686d7e-f063-496f-90d3-a02dd52ac10c admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:15.815514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0686d7e-f063-496f-90d3-a02dd52ac10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:15.817422 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0686d7e-f063-496f-90d3-a02dd52ac10c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:15.922736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1396/2802] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:24:15 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:15.926978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b2e6-d161-40bd-b502-655086545e6e admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:15.938076 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b2e6-d161-40bd-b502-655086545e6e admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:15.942788 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85fa33-8d45-4aaa-8111-715ffca4439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:15.943456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85fa33-8d45-4aaa-8111-715ffca4439d admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:15.943742 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85fa33-8d45-4aaa-8111-715ffca4439d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:15.944091 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85fa33-8d45-4aaa-8111-715ffca4439d admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:15.944822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85fa33-8d45-4aaa-8111-715ffca4439d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:15.946519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85fa33-8d45-4aaa-8111-715ffca4439d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:15.957480 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1407/2803] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:15.961306 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0686d7e-f063-496f-90d3-a02dd52ac10c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:15.971315 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0686d7e-f063-496f-90d3-a02dd52ac10c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:15.976424 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eddb1-d6d2-42f8-a7d1-639ecf3d6a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:15.977330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eddb1-d6d2-42f8-a7d1-639ecf3d6a6b admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:15.977615 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eddb1-d6d2-42f8-a7d1-639ecf3d6a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:15.977888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eddb1-d6d2-42f8-a7d1-639ecf3d6a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:15.978647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eddb1-d6d2-42f8-a7d1-639ecf3d6a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:15.980228 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eddb1-d6d2-42f8-a7d1-639ecf3d6a6b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:15.991257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1397/2804] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:15.995388 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85fa33-8d45-4aaa-8111-715ffca4439d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:16.005390 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85fa33-8d45-4aaa-8111-715ffca4439d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:16.010161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:16.011044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:16.011336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:16.011624 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] PATH_INFO: `/v3/projects/531b198ccfa04c68989e0400f0747864/users/9c7b9ee5368a4b61b91924498fa0971d/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:16.026528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531b198ccfa04c68989e0400f0747864, user_id=9c7b9ee5368a4b61b91924498fa0971d, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:16.029197 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:16.130035 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1408/2805] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:24:15 2022] PUT /identity/v3/projects/531b198ccfa04c68989e0400f0747864/users/9c7b9ee5368a4b61b91924498fa0971d/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:16.135390 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b41-7593-4717-8010-a20d1ba231d8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:16.135685 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b41-7593-4717-8010-a20d1ba231d8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:16.135966 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b41-7593-4717-8010-a20d1ba231d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:16.142822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:16.154005 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ab6b4b41-7593-4717-8010-a20d1ba231d8 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:16.155237 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ab6b4b41-7593-4717-8010-a20d1ba231d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:16.217318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1398/2806] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:16.227712 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:16.229465 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:16.285962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5cab0-5fd8-40bc-9575-7d18fde16445 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:16.290179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b1e4a-4501-4407-905a-2116a29c77a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:16.290816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b1e4a-4501-4407-905a-2116a29c77a5 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:16.291101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b1e4a-4501-4407-905a-2116a29c77a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:16.294274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b1e4a-4501-4407-905a-2116a29c77a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:16.300372 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b1e4a-4501-4407-905a-2116a29c77a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:16.301780 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b1e4a-4501-4407-905a-2116a29c77a5 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:16.311096 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1409/2807] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:21.635856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508cfbf-bff0-42b1-ae0c-1ff32cd2bd68 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:21.636450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508cfbf-bff0-42b1-ae0c-1ff32cd2bd68 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:21.636450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508cfbf-bff0-42b1-ae0c-1ff32cd2bd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:21.674704 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-c508cfbf-bff0-42b1-ae0c-1ff32cd2bd68 None None] MFA Rules not processed for user `9c7b9ee5368a4b61b91924498fa0971d`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:21.675942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c508cfbf-bff0-42b1-ae0c-1ff32cd2bd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:21.761406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1399/2808] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:24:21.765739 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b1e4a-4501-4407-905a-2116a29c77a5 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:21.776646 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b1e4a-4501-4407-905a-2116a29c77a5 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:21.781846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a5c55-5f68-44af-8268-201dcffd4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:21.782644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a5c55-5f68-44af-8268-201dcffd4278 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:21.782998 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a5c55-5f68-44af-8268-201dcffd4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:21.783347 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a5c55-5f68-44af-8268-201dcffd4278 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:21.784113 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a5c55-5f68-44af-8268-201dcffd4278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:21.786144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a5c55-5f68-44af-8268-201dcffd4278 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:21.885822 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1410/2809] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:24:21 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:21.889618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508cfbf-bff0-42b1-ae0c-1ff32cd2bd68 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:21.901286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508cfbf-bff0-42b1-ae0c-1ff32cd2bd68 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:21.974414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af5703-ae09-4f73-bd24-79439f40fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:21.975104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af5703-ae09-4f73-bd24-79439f40fc86 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:21.975389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af5703-ae09-4f73-bd24-79439f40fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:21.976573 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af5703-ae09-4f73-bd24-79439f40fc86 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:21.977157 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af5703-ae09-4f73-bd24-79439f40fc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:21.979195 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af5703-ae09-4f73-bd24-79439f40fc86 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:22.108397 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1400/2810] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:24:21 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:24:22.112685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a5c55-5f68-44af-8268-201dcffd4278 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:22.126393 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a5c55-5f68-44af-8268-201dcffd4278 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:22.131461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c40619-686f-4232-b5c2-5c73372dd91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:22.132179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c40619-686f-4232-b5c2-5c73372dd91a admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:22.132468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c40619-686f-4232-b5c2-5c73372dd91a admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:22.132751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c40619-686f-4232-b5c2-5c73372dd91a admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:22.133497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c40619-686f-4232-b5c2-5c73372dd91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:22.135314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c40619-686f-4232-b5c2-5c73372dd91a admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:22.148778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1411/2811] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:24:22.153661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af5703-ae09-4f73-bd24-79439f40fc86 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:22.165244 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af5703-ae09-4f73-bd24-79439f40fc86 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:22.170327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf209f-bec4-4211-8081-5740c25fd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:22.171224 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf209f-bec4-4211-8081-5740c25fd3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:22.171505 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf209f-bec4-4211-8081-5740c25fd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:22.171781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf209f-bec4-4211-8081-5740c25fd3c4 admin admin] PATH_INFO: `/v3/projects/68e796b656c24428bbbea767b45eabd7/users/29783741ec3940feb7f677bd4b66751d/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:22.186773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf209f-bec4-4211-8081-5740c25fd3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e796b656c24428bbbea767b45eabd7, user_id=29783741ec3940feb7f677bd4b66751d, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:22.189430 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf209f-bec4-4211-8081-5740c25fd3c4 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:22.256475 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:22.261267 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1401/2812] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:24:22 2022] PUT /identity/v3/projects/68e796b656c24428bbbea767b45eabd7/users/29783741ec3940feb7f677bd4b66751d/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:22.270695 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c40619-686f-4232-b5c2-5c73372dd91a admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:22.281261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c40619-686f-4232-b5c2-5c73372dd91a admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:22.290744 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:22.339809 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954815b-32a7-444b-98f3-6f3b89d56fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:22.340475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954815b-32a7-444b-98f3-6f3b89d56fee admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:22.340760 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954815b-32a7-444b-98f3-6f3b89d56fee admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:22.341038 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954815b-32a7-444b-98f3-6f3b89d56fee admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:22.341782 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954815b-32a7-444b-98f3-6f3b89d56fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:22.343430 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954815b-32a7-444b-98f3-6f3b89d56fee admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:22.354548 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1412/2813] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:22.358807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf209f-bec4-4211-8081-5740c25fd3c4 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:22.369292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf209f-bec4-4211-8081-5740c25fd3c4 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:22.375909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:22.377496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:22.378025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:22.378579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] PATH_INFO: `/v3/projects/68e796b656c24428bbbea767b45eabd7/users/29783741ec3940feb7f677bd4b66751d/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:22.382129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e796b656c24428bbbea767b45eabd7, user_id=29783741ec3940feb7f677bd4b66751d, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:22.387014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:22.398563 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1402/2814] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:24:22 2022] PUT /identity/v3/projects/68e796b656c24428bbbea767b45eabd7/users/29783741ec3940feb7f677bd4b66751d/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:27.899730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce7dd-c564-4f3d-ab76-b1c4c680354c None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:27.900255 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce7dd-c564-4f3d-ab76-b1c4c680354c None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:27.900356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce7dd-c564-4f3d-ab76-b1c4c680354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:27.934267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d9fce7dd-c564-4f3d-ab76-b1c4c680354c None None] MFA Rules not processed for user `29783741ec3940feb7f677bd4b66751d`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:27.935663 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d9fce7dd-c564-4f3d-ab76-b1c4c680354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:28.021943 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1413/2815] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:24:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:28.035035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:28.050150 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:28.152679 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b8233-a63e-42e5-b66e-0d0f407d36b3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:28.156358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42bb727957e40dca943c47785819223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:28.157011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:28.157299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:28.157659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:28.224697 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:28.226201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:28.236618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1403/2816] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:28.484924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14df9-be4f-47c7-b455-418098d941e6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:28.485226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14df9-be4f-47c7-b455-418098d941e6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:28.485523 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14df9-be4f-47c7-b455-418098d941e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:28.549365 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-33b14df9-be4f-47c7-b455-418098d941e6 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:28.550678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-33b14df9-be4f-47c7-b455-418098d941e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:28.633006 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:28.641332 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1414/2817] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:24:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:28.684700 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:28.686269 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:28.799863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:28.802943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3fb4c-24f1-418c-a615-e6ad622eab9f service glance] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:28.808303 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:28.815520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:28.815520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:28.815520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:28.819417 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:28.821568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:28.830863 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1404/2818] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:24:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:24:38.671668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:38.870532 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=4 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:40.025183 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274deb2-582b-4a38-8136-48900e0c7ce8 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:40.025798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274deb2-582b-4a38-8136-48900e0c7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:40.025798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274deb2-582b-4a38-8136-48900e0c7ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:40.043909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c274deb2-582b-4a38-8136-48900e0c7ce8 None None] MFA Rules not processed for user `9c7b9ee5368a4b61b91924498fa0971d`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:40.045136 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c274deb2-582b-4a38-8136-48900e0c7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:40.052851 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1415/2819] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:24:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:40.922699 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:40.924369 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:41.019600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2a987-9a42-482b-bbd3-ba57ee721d9a service swift] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:41.019600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:41.019600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:41.019600 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:41.019990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:41.019990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:41.019990 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:41.020389 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:41.034135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1405/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:44.701137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5ced-0b61-4e67-9c59-77ce9a82df09 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:44.701137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5ced-0b61-4e67-9c59-77ce9a82df09 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:44.701137 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5ced-0b61-4e67-9c59-77ce9a82df09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:44.716791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4c4c5ced-0b61-4e67-9c59-77ce9a82df09 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:44.718743 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4c4c5ced-0b61-4e67-9c59-77ce9a82df09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:44.728529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1416/2821] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:24:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:44.740844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:44.755098 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702dfee-ca3c-4c1c-aa02-118f349386bb service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:44.760120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a440e-6d48-4965-89db-087003585d3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:44.760762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a440e-6d48-4965-89db-087003585d3c service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:44.761035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a440e-6d48-4965-89db-087003585d3c service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:44.761305 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a440e-6d48-4965-89db-087003585d3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:44.771749 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a440e-6d48-4965-89db-087003585d3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:44.773368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a440e-6d48-4965-89db-087003585d3c service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:44.785561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1406/2822] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:24:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:24:54.710561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:54.779743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=38 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:00.020062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5ced-0b61-4e67-9c59-77ce9a82df09 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:00.021552 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4c4c5ced-0b61-4e67-9c59-77ce9a82df09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:00.107072 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5ced-0b61-4e67-9c59-77ce9a82df09 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:00.113162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:00.113839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:00.114150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:00.114446 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:00.116918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:00.130000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:00.131678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:00.145833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1417/2823] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:10.138878 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=34 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:22.025103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a440e-6d48-4965-89db-087003585d3c service swift] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:22.080407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a440e-6d48-4965-89db-087003585d3c service swift] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:22.084245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddadb1b-6f54-49a3-8a85-b6d7f0cbe730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:22.084888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadb1b-6f54-49a3-8a85-b6d7f0cbe730 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:22.085171 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadb1b-6f54-49a3-8a85-b6d7f0cbe730 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:22.085448 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadb1b-6f54-49a3-8a85-b6d7f0cbe730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:22.095313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddadb1b-6f54-49a3-8a85-b6d7f0cbe730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:22.096736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddadb1b-6f54-49a3-8a85-b6d7f0cbe730 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:22.106585 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1407/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:32.102416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=26 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:35.333861 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:35.335329 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:35.350165 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c647-669d-467b-936f-fdea285ae19f service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:35.355507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:35.356156 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:35.356444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:35.356727 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:35.358543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:35.370295 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:35.371857 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:35.382085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1418/2825] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:26:45.377944 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:27.273517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddadb1b-6f54-49a3-8a85-b6d7f0cbe730 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:27.283025 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddadb1b-6f54-49a3-8a85-b6d7f0cbe730 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:27.286687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5a4eb-ec42-4b86-8ef2-244050c01562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:27.287324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a4eb-ec42-4b86-8ef2-244050c01562 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:27.287605 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a4eb-ec42-4b86-8ef2-244050c01562 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:27.287879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a4eb-ec42-4b86-8ef2-244050c01562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:27.289664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-71c5a4eb-ec42-4b86-8ef2-244050c01562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:27.304040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5a4eb-ec42-4b86-8ef2-244050c01562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:27.305518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5a4eb-ec42-4b86-8ef2-244050c01562 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:27.317928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1408/2826] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:28.494805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:28.496267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:28.507797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07cb1d-a60e-456f-8e64-c4bcb251830b service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:28.511879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:28.512544 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:28.512812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:28.513095 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:28.514844 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:28.528984 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:28.530436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:28.542849 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1419/2827] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:30.965241 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c59ad-d3b0-4ff1-88cc-d28513e973b1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:30.965710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c59ad-d3b0-4ff1-88cc-d28513e973b1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:30.969279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c59ad-d3b0-4ff1-88cc-d28513e973b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:30.985329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-517c59ad-d3b0-4ff1-88cc-d28513e973b1 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:30.986570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-517c59ad-d3b0-4ff1-88cc-d28513e973b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:30.993806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1409/2828] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jul 11 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:31.034764 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:31.046289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1130c-76d6-45b3-8300-37908062668e service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:31.052186 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173598dd-cc18-4c7a-ac45-15b1fcb8daa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:31.052858 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173598dd-cc18-4c7a-ac45-15b1fcb8daa4 service swift] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:31.053152 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173598dd-cc18-4c7a-ac45-15b1fcb8daa4 service swift] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:31.053436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173598dd-cc18-4c7a-ac45-15b1fcb8daa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:31.062080 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173598dd-cc18-4c7a-ac45-15b1fcb8daa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:31.064330 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173598dd-cc18-4c7a-ac45-15b1fcb8daa4 service swift] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:31.072656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1420/2829] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:28:32.242120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9dea-7e63-4a7d-99c0-e3003db3dcce None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:32.242577 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9dea-7e63-4a7d-99c0-e3003db3dcce None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:32.243678 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9dea-7e63-4a7d-99c0-e3003db3dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:32.260982 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-81ce9dea-7e63-4a7d-99c0-e3003db3dcce None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:32.262232 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-81ce9dea-7e63-4a7d-99c0-e3003db3dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:32.270091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1410/2830] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:32.282320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173598dd-cc18-4c7a-ac45-15b1fcb8daa4 service swift] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:32.293166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173598dd-cc18-4c7a-ac45-15b1fcb8daa4 service swift] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:32.299117 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86611ee-3c8e-4af6-a205-d1ae10ef2547 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:32.299796 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86611ee-3c8e-4af6-a205-d1ae10ef2547 service swift] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:32.300087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86611ee-3c8e-4af6-a205-d1ae10ef2547 service swift] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:32.300398 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86611ee-3c8e-4af6-a205-d1ae10ef2547 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:32.308639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86611ee-3c8e-4af6-a205-d1ae10ef2547 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:32.310252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86611ee-3c8e-4af6-a205-d1ae10ef2547 service swift] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:32.319069 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1421/2831] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:28:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:28:42.255646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=12 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:42.317508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=18 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:42.436073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bc9a-3004-4983-8ac2-dfbb534ba9ec None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.436385 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bc9a-3004-4983-8ac2-dfbb534ba9ec None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.436710 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bc9a-3004-4983-8ac2-dfbb534ba9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.456138 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-83d9bc9a-3004-4983-8ac2-dfbb534ba9ec None None] MFA Rules not processed for user `9c7b9ee5368a4b61b91924498fa0971d`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:42.458245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-83d9bc9a-3004-4983-8ac2-dfbb534ba9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:42.464471 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1411/2832] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:42.719885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86611ee-3c8e-4af6-a205-d1ae10ef2547 service swift] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.730985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86611ee-3c8e-4af6-a205-d1ae10ef2547 service swift] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.734666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.735316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.735600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.735884 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.737698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:42.748512 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.750562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.759026 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1422/2833] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:47.658064 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d41a7-568f-4d67-8cb7-a92eb2741522 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:47.658588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d41a7-568f-4d67-8cb7-a92eb2741522 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:47.658779 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d41a7-568f-4d67-8cb7-a92eb2741522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:47.677795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-cf0d41a7-568f-4d67-8cb7-a92eb2741522 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:47.679038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-cf0d41a7-568f-4d67-8cb7-a92eb2741522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:47.686454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1412/2834] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:47.699323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:47.712304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d496a-427a-490f-a729-212f2034a845 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:47.717434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:47.718083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:47.718416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:47.719220 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:47.728062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:47.729891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:47.739397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1423/2835] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:28:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:28:56.604598 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d41a7-568f-4d67-8cb7-a92eb2741522 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.614313 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d41a7-568f-4d67-8cb7-a92eb2741522 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.617986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.618659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.618942 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.619220 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.621020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:56.642391 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.643905 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.652348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1413/2836] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:57.736190 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=12 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:06.648572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=16 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:23.321767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:23.324513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:23.348150 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590f9ac-abce-4ef9-b59f-e455ca1c2a72 service swift] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:23.356414 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:23.357084 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:23.357377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:23.357660 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:23.359541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:23.372933 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:23.378330 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:23.386000 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1424/2837] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:29:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:29:26.297432 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:26.319308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190bf9c-c178-40d4-9a0c-161a192a1b20 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:26.330701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d447a5a-6185-4db9-9efe-1ec7978b63e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:26.330701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447a5a-6185-4db9-9efe-1ec7978b63e1 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:26.330701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447a5a-6185-4db9-9efe-1ec7978b63e1 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:26.330701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447a5a-6185-4db9-9efe-1ec7978b63e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:26.331849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6d447a5a-6185-4db9-9efe-1ec7978b63e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:26.345904 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d447a5a-6185-4db9-9efe-1ec7978b63e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:26.347630 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d447a5a-6185-4db9-9efe-1ec7978b63e1 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:26.362760 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1414/2838] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:29:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:29:33.381879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:36.355440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:39.670278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:39.681648 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d05835-00b7-40bc-a6aa-da04aeac0d9b service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:39.687754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf33d2f-dfab-47e1-ab68-f6f4f260d2ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:39.688386 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf33d2f-dfab-47e1-ab68-f6f4f260d2ee service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:39.688669 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf33d2f-dfab-47e1-ab68-f6f4f260d2ee service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:39.688947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf33d2f-dfab-47e1-ab68-f6f4f260d2ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:39.696832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf33d2f-dfab-47e1-ab68-f6f4f260d2ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:39.698420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf33d2f-dfab-47e1-ab68-f6f4f260d2ee service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:39.707870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1425/2839] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:29:49.703968 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:43.686148 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10958b-d078-4f95-96ca-7d1d36dc3ddf None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:43.686799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10958b-d078-4f95-96ca-7d1d36dc3ddf None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:43.686799 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10958b-d078-4f95-96ca-7d1d36dc3ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:43.705321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-0d10958b-d078-4f95-96ca-7d1d36dc3ddf None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:30:43.706609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-0d10958b-d078-4f95-96ca-7d1d36dc3ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:43.734596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1415/2840] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jul 11 15:30:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:30:43.778722 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf33d2f-dfab-47e1-ab68-f6f4f260d2ee service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:43.820798 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf33d2f-dfab-47e1-ab68-f6f4f260d2ee service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:43.826557 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92df1-4ad9-4208-9bf4-e9b6c27dff97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:43.827194 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92df1-4ad9-4208-9bf4-e9b6c27dff97 service swift] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:43.827479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92df1-4ad9-4208-9bf4-e9b6c27dff97 service swift] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:43.827755 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92df1-4ad9-4208-9bf4-e9b6c27dff97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:43.836307 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd92df1-4ad9-4208-9bf4-e9b6c27dff97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:43.837906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd92df1-4ad9-4208-9bf4-e9b6c27dff97 service swift] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:43.847002 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1426/2841] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:30:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:30:44.772018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10958b-d078-4f95-96ca-7d1d36dc3ddf None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:44.783192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10958b-d078-4f95-96ca-7d1d36dc3ddf None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:44.786824 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8378-f473-42e2-ab92-a1ad90ed5ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:44.787477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8378-f473-42e2-ab92-a1ad90ed5ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:44.787765 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8378-f473-42e2-ab92-a1ad90ed5ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:44.788044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8378-f473-42e2-ab92-a1ad90ed5ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:44.851791 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8378-f473-42e2-ab92-a1ad90ed5ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:44.853247 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8378-f473-42e2-ab92-a1ad90ed5ee2 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:44.863874 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1416/2842] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:30:48.241602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92df1-4ad9-4208-9bf4-e9b6c27dff97 service swift] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:48.254082 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92df1-4ad9-4208-9bf4-e9b6c27dff97 service swift] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:48.262370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:48.263939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:48.263939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:48.263939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:48.265792 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:48.278694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:48.280323 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:48.291385 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1427/2843] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:30:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:30:52.036653 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8378-f473-42e2-ab92-a1ad90ed5ee2 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:52.048648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8378-f473-42e2-ab92-a1ad90ed5ee2 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:52.056820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:52.056820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:52.056820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:52.056820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:52.057216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:52.069197 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:52.070809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:52.082235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1417/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:30:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:30:52.171962 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:52.187779 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7222a-5226-46a0-8a49-a05e7c05a4ff service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:52.192945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:52.193862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:52.194174 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:52.194456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] PATH_INFO: `/v3/users/9c7b9ee5368a4b61b91924498fa0971d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:52.195667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7b9ee5368a4b61b91924498fa0971d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:52.197584 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:52.379444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7b9ee5368a4b61b91924498fa0971d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:52.453330 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7b9ee5368a4b61b91924498fa0971d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:52.472324 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7b9ee5368a4b61b91924498fa0971d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:52.479701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7b9ee5368a4b61b91924498fa0971d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:52.480424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7b9ee5368a4b61b91924498fa0971d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:52.487003 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1428/2845] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:30:52 2022] DELETE /identity/v3/users/9c7b9ee5368a4b61b91924498fa0971d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:30:52.733077 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:52.745764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327250a-337f-4ffc-a9bd-4b0418199fad service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:52.806276 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:52.807129 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:52.807415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:52.807691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] PATH_INFO: `/v3/projects/531b198ccfa04c68989e0400f0747864` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:52.808879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531b198ccfa04c68989e0400f0747864)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:52.811407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:52.925828 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531b198ccfa04c68989e0400f0747864', 'request_id': 'req-6cf9ada8-db95-4481-8c18-04046e229ca4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.003762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531b198ccfa04c68989e0400f0747864', 'request_id': 'req-6cf9ada8-db95-4481-8c18-04046e229ca4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.005216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:53.010708 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531b198ccfa04c68989e0400f0747864', 'request_id': 'req-6cf9ada8-db95-4481-8c18-04046e229ca4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.022239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] The token cache is being invalidate because project 531b198ccfa04c68989e0400f0747864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:30:53.022529 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.023194 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.024748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1418/2846] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:30:52 2022] DELETE /identity/v3/projects/531b198ccfa04c68989e0400f0747864 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:30:53.029470 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:53.030942 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:53.045384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ce572-1069-4069-86d3-cb9782da9cd3 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:53.107751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:53.108628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:53.108907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:53.109177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] PATH_INFO: `/v3/users/29783741ec3940feb7f677bd4b66751d` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:53.110461 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29783741ec3940feb7f677bd4b66751d)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:53.112392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:53.128484 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:53.248820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29783741ec3940feb7f677bd4b66751d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.307954 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29783741ec3940feb7f677bd4b66751d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.322138 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29783741ec3940feb7f677bd4b66751d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.330133 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29783741ec3940feb7f677bd4b66751d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.332375 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-c96ce3c2-05d9-4c25-a6c8-cff383b8819d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29783741ec3940feb7f677bd4b66751d'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.337620 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1429/2847] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:30:53 2022] DELETE /identity/v3/users/29783741ec3940feb7f677bd4b66751d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:30:53.584414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:53.585929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:53.599299 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ada8-db95-4481-8c18-04046e229ca4 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:53.661795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:53.662695 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:53.662991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:53.663265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] PATH_INFO: `/v3/projects/68e796b656c24428bbbea767b45eabd7` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:53.664520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e796b656c24428bbbea767b45eabd7)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:53.666552 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:53.769059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e796b656c24428bbbea767b45eabd7', 'request_id': 'req-499d5dfe-842f-4c3c-8855-dfeecc111d84'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.845071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e796b656c24428bbbea767b45eabd7', 'request_id': 'req-499d5dfe-842f-4c3c-8855-dfeecc111d84'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.851316 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e796b656c24428bbbea767b45eabd7', 'request_id': 'req-499d5dfe-842f-4c3c-8855-dfeecc111d84'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.862959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] The token cache is being invalidate because project 68e796b656c24428bbbea767b45eabd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:30:53.863245 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.863895 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-499d5dfe-842f-4c3c-8855-dfeecc111d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:30:53.865479 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1419/2848] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:30:53 2022] DELETE /identity/v3/projects/68e796b656c24428bbbea767b45eabd7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:30:53.870850 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8af43-95f8-4367-bbf2-94ca34ac32e4 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:53.871148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8af43-95f8-4367-bbf2-94ca34ac32e4 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:53.871438 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8af43-95f8-4367-bbf2-94ca34ac32e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:53.890740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-eda8af43-95f8-4367-bbf2-94ca34ac32e4 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:30:53.891977 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-eda8af43-95f8-4367-bbf2-94ca34ac32e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:53.954005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1430/2849] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:30:53.961862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d8d5-0abb-4bf6-961f-76ff25dfe6c2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:53.962189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d8d5-0abb-4bf6-961f-76ff25dfe6c2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:53.962481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d8d5-0abb-4bf6-961f-76ff25dfe6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:53.982361 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-7447d8d5-0abb-4bf6-961f-76ff25dfe6c2 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:30:53.983576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-7447d8d5-0abb-4bf6-961f-76ff25dfe6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:53.992124 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1420/2850] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:30:53.996454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8af43-95f8-4367-bbf2-94ca34ac32e4 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:54.007252 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8af43-95f8-4367-bbf2-94ca34ac32e4 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:54.011941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:54.012644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.012934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.013213 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.013945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:30:54.014299 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:54.015893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:54.027930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1431/2851] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:30:54.032515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d8d5-0abb-4bf6-961f-76ff25dfe6c2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:54.042560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d8d5-0abb-4bf6-961f-76ff25dfe6c2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:54.047900 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e873-ba10-4d53-9c5d-57215a3fd72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:54.048567 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e873-ba10-4d53-9c5d-57215a3fd72a admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.048855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e873-ba10-4d53-9c5d-57215a3fd72a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.049135 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e873-ba10-4d53-9c5d-57215a3fd72a admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.049829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485e873-ba10-4d53-9c5d-57215a3fd72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:54.051786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485e873-ba10-4d53-9c5d-57215a3fd72a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:54.167379 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1421/2852] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:30:54 2022] POST /identity/v3/projects => generated 391 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:30:54.171969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:54.183803 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320474b-3298-40da-b0e0-0b06c221a826 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:54.243497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7805f88-50aa-4cd1-aaa4-0470a84ce9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:54.244175 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7805f88-50aa-4cd1-aaa4-0470a84ce9dd admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.244466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7805f88-50aa-4cd1-aaa4-0470a84ce9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.244750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7805f88-50aa-4cd1-aaa4-0470a84ce9dd admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.245458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7805f88-50aa-4cd1-aaa4-0470a84ce9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:54.248057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7805f88-50aa-4cd1-aaa4-0470a84ce9dd admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:54.320591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1432/2853] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:30:54 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:30:54.324520 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e873-ba10-4d53-9c5d-57215a3fd72a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:54.338458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e873-ba10-4d53-9c5d-57215a3fd72a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:54.345534 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39538ad-9683-4de6-b044-5450bca477b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:54.346233 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39538ad-9683-4de6-b044-5450bca477b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.346568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39538ad-9683-4de6-b044-5450bca477b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.346970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39538ad-9683-4de6-b044-5450bca477b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.347815 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39538ad-9683-4de6-b044-5450bca477b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:54.349506 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39538ad-9683-4de6-b044-5450bca477b3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:54.361481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1422/2854] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:30:54.365615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7805f88-50aa-4cd1-aaa4-0470a84ce9dd admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:54.376007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7805f88-50aa-4cd1-aaa4-0470a84ce9dd admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:54.380724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80d02-8cb3-4768-9167-64f31b8f3479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:54.381384 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80d02-8cb3-4768-9167-64f31b8f3479 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.381670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80d02-8cb3-4768-9167-64f31b8f3479 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.381946 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80d02-8cb3-4768-9167-64f31b8f3479 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.382711 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80d02-8cb3-4768-9167-64f31b8f3479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:54.384290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80d02-8cb3-4768-9167-64f31b8f3479 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:54.389808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:54.395565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1433/2855] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:30:54.399856 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39538ad-9683-4de6-b044-5450bca477b3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:54.410647 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39538ad-9683-4de6-b044-5450bca477b3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:54.415462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427fdc-60d9-411c-9d66-b1964533044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:54.416347 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427fdc-60d9-411c-9d66-b1964533044b admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.416633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427fdc-60d9-411c-9d66-b1964533044b admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.416913 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427fdc-60d9-411c-9d66-b1964533044b admin admin] PATH_INFO: `/v3/projects/6a448d933290472e93921b4a29bd187e/users/1bb6628db9b0400e9fb5ee688e376277/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.437903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e427fdc-60d9-411c-9d66-b1964533044b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a448d933290472e93921b4a29bd187e, user_id=1bb6628db9b0400e9fb5ee688e376277, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:54.437903 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e427fdc-60d9-411c-9d66-b1964533044b admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:54.497093 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1423/2856] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:30:54 2022] PUT /identity/v3/projects/6a448d933290472e93921b4a29bd187e/users/1bb6628db9b0400e9fb5ee688e376277/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:30:54.509270 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dd1e-828d-450a-87c0-e592c981a7a6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.509845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dd1e-828d-450a-87c0-e592c981a7a6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.510355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dd1e-828d-450a-87c0-e592c981a7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.542889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1367dd1e-828d-450a-87c0-e592c981a7a6 None None] MFA Rules not processed for user `1bb6628db9b0400e9fb5ee688e376277`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:30:54.545366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1367dd1e-828d-450a-87c0-e592c981a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:54.626914 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1434/2857] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:30:54.631759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427fdc-60d9-411c-9d66-b1964533044b admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:54.645787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:54.696358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427fdc-60d9-411c-9d66-b1964533044b admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:54.702027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48fb85-c7ae-482b-92d6-dad0d63dd679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:54.702880 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48fb85-c7ae-482b-92d6-dad0d63dd679 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.703278 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48fb85-c7ae-482b-92d6-dad0d63dd679 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.703670 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48fb85-c7ae-482b-92d6-dad0d63dd679 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.704454 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48fb85-c7ae-482b-92d6-dad0d63dd679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:54.706621 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48fb85-c7ae-482b-92d6-dad0d63dd679 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:54.807503 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1424/2858] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:30:54 2022] POST /identity/v3/projects => generated 393 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:30:54.811573 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367dd1e-828d-450a-87c0-e592c981a7a6 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:54.822746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367dd1e-828d-450a-87c0-e592c981a7a6 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:54.879603 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a27b1-0330-4db2-9beb-1380adbbb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:54.880286 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a27b1-0330-4db2-9beb-1380adbbb9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:54.880578 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a27b1-0330-4db2-9beb-1380adbbb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:54.880859 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a27b1-0330-4db2-9beb-1380adbbb9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:54.881562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a27b1-0330-4db2-9beb-1380adbbb9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:54.883513 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a27b1-0330-4db2-9beb-1380adbbb9b6 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:54.987266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1435/2859] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:30:54 2022] POST /identity/v3/users => generated 303 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:30:54.991235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48fb85-c7ae-482b-92d6-dad0d63dd679 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:55.002120 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48fb85-c7ae-482b-92d6-dad0d63dd679 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:55.008426 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd98f02-68e3-4e7d-ae6d-3a2995cb077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:55.009239 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98f02-68e3-4e7d-ae6d-3a2995cb077a admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:55.009569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98f02-68e3-4e7d-ae6d-3a2995cb077a admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:55.009886 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98f02-68e3-4e7d-ae6d-3a2995cb077a admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:55.010753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd98f02-68e3-4e7d-ae6d-3a2995cb077a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:55.013483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd98f02-68e3-4e7d-ae6d-3a2995cb077a admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:55.024759 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1425/2860] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:30:55.029595 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a27b1-0330-4db2-9beb-1380adbbb9b6 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:55.040639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a27b1-0330-4db2-9beb-1380adbbb9b6 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:55.045458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb0e8f-b444-4d3b-84db-8cae0d60f67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:55.046380 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0e8f-b444-4d3b-84db-8cae0d60f67d admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:55.046683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0e8f-b444-4d3b-84db-8cae0d60f67d admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:55.046969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0e8f-b444-4d3b-84db-8cae0d60f67d admin admin] PATH_INFO: `/v3/projects/c1f8580699b947088ca396dcb827c234/users/8352b2f6c4dd479d966da797e4e5b8bd/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:55.062828 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb0e8f-b444-4d3b-84db-8cae0d60f67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f8580699b947088ca396dcb827c234, user_id=8352b2f6c4dd479d966da797e4e5b8bd, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:55.065607 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb0e8f-b444-4d3b-84db-8cae0d60f67d admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:55.129843 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1436/2861] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:30:55 2022] PUT /identity/v3/projects/c1f8580699b947088ca396dcb827c234/users/8352b2f6c4dd479d966da797e4e5b8bd/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:30:55.133958 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd98f02-68e3-4e7d-ae6d-3a2995cb077a admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:55.144878 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd98f02-68e3-4e7d-ae6d-3a2995cb077a admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:55.201910 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2887d1-6e72-4804-8862-e88d45b25a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:55.202636 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2887d1-6e72-4804-8862-e88d45b25a94 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:55.202921 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2887d1-6e72-4804-8862-e88d45b25a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:55.203202 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2887d1-6e72-4804-8862-e88d45b25a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:55.203940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2887d1-6e72-4804-8862-e88d45b25a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:55.205549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2887d1-6e72-4804-8862-e88d45b25a94 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:55.216143 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1426/2862] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:30:55.220733 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb0e8f-b444-4d3b-84db-8cae0d60f67d admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:55.231266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb0e8f-b444-4d3b-84db-8cae0d60f67d admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:55.235899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:55.236782 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:55.237064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:55.237395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] PATH_INFO: `/v3/projects/c1f8580699b947088ca396dcb827c234/users/8352b2f6c4dd479d966da797e4e5b8bd/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:55.239360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f8580699b947088ca396dcb827c234, user_id=8352b2f6c4dd479d966da797e4e5b8bd, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:55.241982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:55.253222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1437/2863] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:30:55 2022] PUT /identity/v3/projects/c1f8580699b947088ca396dcb827c234/users/8352b2f6c4dd479d966da797e4e5b8bd/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:30:55.263748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa32e9-5f40-4666-95f0-7838b18676f6 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:55.264040 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa32e9-5f40-4666-95f0-7838b18676f6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:55.264321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa32e9-5f40-4666-95f0-7838b18676f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:55.290661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-22fa32e9-5f40-4666-95f0-7838b18676f6 None None] MFA Rules not processed for user `8352b2f6c4dd479d966da797e4e5b8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:30:55.291894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-22fa32e9-5f40-4666-95f0-7838b18676f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:55.361814 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1427/2864] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:30:55.379054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:55.380996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:55.432637 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:55.463911 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a0153-0e76-46c5-8e14-9ee80449fd14 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:55.469903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654df39-c5ee-4968-8ac5-eeb47646436c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:55.470590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654df39-c5ee-4968-8ac5-eeb47646436c service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:55.470874 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654df39-c5ee-4968-8ac5-eeb47646436c service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:55.471146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654df39-c5ee-4968-8ac5-eeb47646436c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:55.535707 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654df39-c5ee-4968-8ac5-eeb47646436c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:55.537273 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654df39-c5ee-4968-8ac5-eeb47646436c service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:55.548154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1438/2865] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:30:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:00.868911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa32e9-5f40-4666-95f0-7838b18676f6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:00.870460 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-22fa32e9-5f40-4666-95f0-7838b18676f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:00.882778 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:31:00.933935 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa32e9-5f40-4666-95f0-7838b18676f6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:00.938476 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:00.939130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:00.939416 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:00.939693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:00.949408 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:00.950918 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:00.961541 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1428/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:04.042928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164903-d524-4771-ad86-0f657eda421d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:04.043916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164903-d524-4771-ad86-0f657eda421d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:04.044245 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164903-d524-4771-ad86-0f657eda421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:04.066051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e8164903-d524-4771-ad86-0f657eda421d None None] MFA Rules not processed for user `1bb6628db9b0400e9fb5ee688e376277`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:31:04.067315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e8164903-d524-4771-ad86-0f657eda421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:04.074860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1439/2867] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:31:04.879923 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:04.881619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:04.976955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2fa92-435d-4411-b511-ec198aec0f55 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:04.982075 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:04.982783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:04.983210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:04.983493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:04.985322 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:04.999875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:05.001897 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:05.018362 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1429/2868] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:13.927723 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164903-d524-4771-ad86-0f657eda421d None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:13.929140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e8164903-d524-4771-ad86-0f657eda421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:13.945941 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164903-d524-4771-ad86-0f657eda421d None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:13.952320 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df560a0-b5bf-4b0f-884f-5f0d56a061ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:13.955928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df560a0-b5bf-4b0f-884f-5f0d56a061ea service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:13.955928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df560a0-b5bf-4b0f-884f-5f0d56a061ea service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:13.955928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df560a0-b5bf-4b0f-884f-5f0d56a061ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:13.955928 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7df560a0-b5bf-4b0f-884f-5f0d56a061ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:13.967488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df560a0-b5bf-4b0f-884f-5f0d56a061ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:13.969268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df560a0-b5bf-4b0f-884f-5f0d56a061ea service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:13.980191 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1440/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:15.009407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=55 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:31:23.975538 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=46 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:31:39.353493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:39.373517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208680e-8028-40bc-be14-c2475711fa52 service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:39.379117 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:39.379758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:39.380044 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:39.380323 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:39.382189 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:39.406937 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:39.408517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:39.418450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1430/2870] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:49.414292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=15 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:32:12.752919 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4c731-6a71-4212-b5b9-56dc5bce2e06 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:32:12.760653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4c731-6a71-4212-b5b9-56dc5bce2e06 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:32:12.761010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4c731-6a71-4212-b5b9-56dc5bce2e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:32:12.784609 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-1ce4c731-6a71-4212-b5b9-56dc5bce2e06 None None] MFA Rules not processed for user `1bb6628db9b0400e9fb5ee688e376277`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:32:12.786009 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-1ce4c731-6a71-4212-b5b9-56dc5bce2e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:32:12.793887 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1441/2871] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:32:13.117911 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:32:13.137932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d857d43-464f-44dd-9a60-74cfaa364f95 service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:32:13.141550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:32:13.142218 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:32:13.142574 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:32:13.143370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:32:13.145210 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:32:13.167731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:32:13.169160 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:32:13.178122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1431/2872] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:32:22.776832 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:32:23.174357 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=15 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:50.912847 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4c731-6a71-4212-b5b9-56dc5bce2e06 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:50.925808 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4c731-6a71-4212-b5b9-56dc5bce2e06 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:50.929664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26c326-afdb-4e58-9a25-8cbc0424bb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:50.930376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c326-afdb-4e58-9a25-8cbc0424bb57 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:50.930657 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c326-afdb-4e58-9a25-8cbc0424bb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:50.930939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c326-afdb-4e58-9a25-8cbc0424bb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:50.932765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2e26c326-afdb-4e58-9a25-8cbc0424bb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:51.091529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26c326-afdb-4e58-9a25-8cbc0424bb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:51.093029 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26c326-afdb-4e58-9a25-8cbc0424bb57 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:51.114676 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1442/2873] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:33:52.294792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:52.296250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:52.308613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ca59-ef89-45f4-854b-13830e9bae89 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:52.312336 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:52.313103 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:52.313396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:52.313694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:52.315493 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:52.329190 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:52.331206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:52.343054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1432/2874] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:34:01.112511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=18 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:34:02.337775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:34:06.390543 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21a33b-efdf-4ebe-a640-287c155c0407 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:34:06.391101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21a33b-efdf-4ebe-a640-287c155c0407 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:34:06.391101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21a33b-efdf-4ebe-a640-287c155c0407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:34:06.408772 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-8e21a33b-efdf-4ebe-a640-287c155c0407 None None] MFA Rules not processed for user `1bb6628db9b0400e9fb5ee688e376277`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:34:06.410236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8e21a33b-efdf-4ebe-a640-287c155c0407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:34:06.417413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1443/2875] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:34:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:34:06.780256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:34:06.790308 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ddcdc-5c7e-446c-83a8-e1371e3d90ed service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:34:06.794768 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda14748-59e6-4862-b082-bc17e29553ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:34:06.795496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda14748-59e6-4862-b082-bc17e29553ec service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:34:06.795780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda14748-59e6-4862-b082-bc17e29553ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:34:06.796054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda14748-59e6-4862-b082-bc17e29553ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:34:06.797945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-bda14748-59e6-4862-b082-bc17e29553ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:34:06.809325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda14748-59e6-4862-b082-bc17e29553ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:34:06.810917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda14748-59e6-4862-b082-bc17e29553ec service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:34:06.820462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1433/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:34:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:34:16.403237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:34:16.815736 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:09.345768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c30fd-cd08-461e-94e2-987f3b7efbbc None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:09.346360 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c30fd-cd08-461e-94e2-987f3b7efbbc None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:09.346478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c30fd-cd08-461e-94e2-987f3b7efbbc None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:09.347771 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1444/2877] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jul 11 15:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:09.353118 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ba9b-8efa-4f2f-a8ea-721cee3d3cc8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:09.353557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ba9b-8efa-4f2f-a8ea-721cee3d3cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:09.353665 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ba9b-8efa-4f2f-a8ea-721cee3d3cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:09.415742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-6505ba9b-8efa-4f2f-a8ea-721cee3d3cc8 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:09.416985 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6505ba9b-8efa-4f2f-a8ea-721cee3d3cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:09.425635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1434/2878] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:35:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:35:09.448835 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c30fd-cd08-461e-94e2-987f3b7efbbc None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:09.450566 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-028c30fd-cd08-461e-94e2-987f3b7efbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:09.467467 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c30fd-cd08-461e-94e2-987f3b7efbbc None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:09.472448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0f335-a1e9-43d6-a845-da565908e0c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:09.473098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f335-a1e9-43d6-a845-da565908e0c2 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:09.473376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f335-a1e9-43d6-a845-da565908e0c2 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:09.473650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f335-a1e9-43d6-a845-da565908e0c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:09.481865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0f335-a1e9-43d6-a845-da565908e0c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:09.483454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0f335-a1e9-43d6-a845-da565908e0c2 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:09.493357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1445/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:35:19.413705 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=17 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:19.490794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:21.537724 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c902-d4dc-4654-b40c-29bb691b1c9f None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:21.538193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c902-d4dc-4654-b40c-29bb691b1c9f None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:21.538295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c902-d4dc-4654-b40c-29bb691b1c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:21.558851 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-3bc4c902-d4dc-4654-b40c-29bb691b1c9f None None] MFA Rules not processed for user `1bb6628db9b0400e9fb5ee688e376277`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:21.560105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-3bc4c902-d4dc-4654-b40c-29bb691b1c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:21.567941 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1435/2880] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:35:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:35:25.444509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0f335-a1e9-43d6-a845-da565908e0c2 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:25.454274 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0f335-a1e9-43d6-a845-da565908e0c2 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:25.458756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:25.459454 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:25.459701 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:25.460275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:25.462054 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:25.472626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:25.474081 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:25.481982 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1446/2881] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:35:26.334002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4c902-d4dc-4654-b40c-29bb691b1c9f None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:26.357225 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4c902-d4dc-4654-b40c-29bb691b1c9f None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:26.363919 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:26.364592 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:26.364875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:26.365153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:26.367094 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:26.380721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:26.382607 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:26.394603 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1436/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:35:35.308364 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:35.323688 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89943d-e8fc-41c6-b2c7-da0d7a4ead5f service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:35.330055 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:35.330700 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:35.330992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:35.331275 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:35.333111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:35.346212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:35.348355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:35.362233 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1447/2883] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:35:36.389300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=9 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:45.354987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=12 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:56.693172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:56.704261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c87963-2f63-48ad-9b09-faaf811c4bad service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:56.710946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e563bd-573a-4ae6-8e18-f5fa878e8fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:56.711439 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e563bd-573a-4ae6-8e18-f5fa878e8fa6 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:56.711743 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e563bd-573a-4ae6-8e18-f5fa878e8fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:56.712023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e563bd-573a-4ae6-8e18-f5fa878e8fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:56.720043 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e563bd-573a-4ae6-8e18-f5fa878e8fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:56.721618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e563bd-573a-4ae6-8e18-f5fa878e8fa6 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:56.732101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1437/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:06.727265 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:45.346345 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:45.357499 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f601c-6a50-47b9-b925-2394c88eba5c service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:45.362626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bdfbd-8877-46e2-86de-28059ac22a0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:45.363257 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bdfbd-8877-46e2-86de-28059ac22a0a service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:45.363541 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bdfbd-8877-46e2-86de-28059ac22a0a service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:45.363818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bdfbd-8877-46e2-86de-28059ac22a0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:45.372363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bdfbd-8877-46e2-86de-28059ac22a0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:45.373906 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bdfbd-8877-46e2-86de-28059ac22a0a service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:45.384267 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1448/2885] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:55.379930 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:07.329865 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e563bd-573a-4ae6-8e18-f5fa878e8fa6 service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:07.341906 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e563bd-573a-4ae6-8e18-f5fa878e8fa6 service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:07.347072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d440a1-11af-41ed-80fd-3b687761a96f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:07.347810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d440a1-11af-41ed-80fd-3b687761a96f service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.348100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d440a1-11af-41ed-80fd-3b687761a96f service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.348381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d440a1-11af-41ed-80fd-3b687761a96f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.350848 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-91d440a1-11af-41ed-80fd-3b687761a96f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:07.362844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d440a1-11af-41ed-80fd-3b687761a96f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:07.364470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d440a1-11af-41ed-80fd-3b687761a96f service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:07.375414 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1438/2886] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:37:12.361087 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bdfbd-8877-46e2-86de-28059ac22a0a service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.370922 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bdfbd-8877-46e2-86de-28059ac22a0a service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.374766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b393de-18ba-433c-a287-0108642d4e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.375602 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b393de-18ba-433c-a287-0108642d4e05 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.375956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b393de-18ba-433c-a287-0108642d4e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.376304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b393de-18ba-433c-a287-0108642d4e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.386507 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b393de-18ba-433c-a287-0108642d4e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.387926 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b393de-18ba-433c-a287-0108642d4e05 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.398226 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1449/2887] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:37:15.872975 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2f63-3af4-425f-9b03-de2b5e79a22a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.873418 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2f63-3af4-425f-9b03-de2b5e79a22a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.873733 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2f63-3af4-425f-9b03-de2b5e79a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.894504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-e5ab2f63-3af4-425f-9b03-de2b5e79a22a None None] MFA Rules not processed for user `1bb6628db9b0400e9fb5ee688e376277`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:15.895930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-e5ab2f63-3af4-425f-9b03-de2b5e79a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:15.904059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1439/2888] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:37:16.344678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b393de-18ba-433c-a287-0108642d4e05 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.357736 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b393de-18ba-433c-a287-0108642d4e05 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.367529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b875-45bb-40ae-a9fe-93a37a602777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:16.368376 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b875-45bb-40ae-a9fe-93a37a602777 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.369260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b875-45bb-40ae-a9fe-93a37a602777 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.369260 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b875-45bb-40ae-a9fe-93a37a602777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.379256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b875-45bb-40ae-a9fe-93a37a602777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:16.382313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b875-45bb-40ae-a9fe-93a37a602777 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.393639 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1450/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:37:16.890557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab2f63-3af4-425f-9b03-de2b5e79a22a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.904324 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab2f63-3af4-425f-9b03-de2b5e79a22a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.911017 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f57cc-e009-4909-b41e-51ed439c261d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:16.914499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f57cc-e009-4909-b41e-51ed439c261d service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.914499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f57cc-e009-4909-b41e-51ed439c261d service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.914499 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f57cc-e009-4909-b41e-51ed439c261d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.923116 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f57cc-e009-4909-b41e-51ed439c261d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:16.924775 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f57cc-e009-4909-b41e-51ed439c261d service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.948551 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1440/2890] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:37:25.579698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b875-45bb-40ae-a9fe-93a37a602777 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.593761 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b875-45bb-40ae-a9fe-93a37a602777 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.599297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20a300-fc80-46c3-800e-514470a7127e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.599936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a300-fc80-46c3-800e-514470a7127e service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.600229 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a300-fc80-46c3-800e-514470a7127e service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.600510 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a300-fc80-46c3-800e-514470a7127e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.609605 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20a300-fc80-46c3-800e-514470a7127e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:25.611277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20a300-fc80-46c3-800e-514470a7127e service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:25.622280 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1451/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:37:26.932090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=15 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:35.617804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=18 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:16.776884 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f57cc-e009-4909-b41e-51ed439c261d service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:16.856445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f57cc-e009-4909-b41e-51ed439c261d service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:16.860998 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:16.863658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:16.863658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:16.863658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] PATH_INFO: `/v3/users/1bb6628db9b0400e9fb5ee688e376277` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:16.863658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb6628db9b0400e9fb5ee688e376277)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:16.865557 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:17.045981 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb6628db9b0400e9fb5ee688e376277'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.146718 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb6628db9b0400e9fb5ee688e376277'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.159683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb6628db9b0400e9fb5ee688e376277'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.160333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb6628db9b0400e9fb5ee688e376277'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.167907 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb6628db9b0400e9fb5ee688e376277'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.174028 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1441/2892] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:38:16 2022] DELETE /identity/v3/users/1bb6628db9b0400e9fb5ee688e376277 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:17.178684 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254ddb-89cb-4ed2-afee-9d7f800ef4b5 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:17.184410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254ddb-89cb-4ed2-afee-9d7f800ef4b5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:17.184410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254ddb-89cb-4ed2-afee-9d7f800ef4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:17.216921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-61254ddb-89cb-4ed2-afee-9d7f800ef4b5 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:17.218177 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-61254ddb-89cb-4ed2-afee-9d7f800ef4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:17.274978 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1452/2893] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:17.284620 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:17.286131 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:17.343568 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb7953-9217-4403-967a-b62fab1412fd admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:17.347147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c0d5-e172-4b04-b7e2-631c39e9746c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:17.347788 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c0d5-e172-4b04-b7e2-631c39e9746c service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:17.348071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c0d5-e172-4b04-b7e2-631c39e9746c service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:17.348348 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c0d5-e172-4b04-b7e2-631c39e9746c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:17.357943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7c0d5-e172-4b04-b7e2-631c39e9746c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:17.359445 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7c0d5-e172-4b04-b7e2-631c39e9746c service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:17.368962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1442/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:38:17.610766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254ddb-89cb-4ed2-afee-9d7f800ef4b5 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:17.615797 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-61254ddb-89cb-4ed2-afee-9d7f800ef4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:17.625004 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254ddb-89cb-4ed2-afee-9d7f800ef4b5 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:17.629838 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:17.630785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:17.631067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:17.631341 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] PATH_INFO: `/v3/projects/6a448d933290472e93921b4a29bd187e` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:17.633088 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a448d933290472e93921b4a29bd187e)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:17.635058 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:17.752677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a448d933290472e93921b4a29bd187e', 'request_id': 'req-d32b30a7-0c65-4509-87a3-aad55abaaf53'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.833413 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a448d933290472e93921b4a29bd187e', 'request_id': 'req-d32b30a7-0c65-4509-87a3-aad55abaaf53'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.840481 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a448d933290472e93921b4a29bd187e', 'request_id': 'req-d32b30a7-0c65-4509-87a3-aad55abaaf53'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.851059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] The token cache is being invalidate because project 6a448d933290472e93921b4a29bd187e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:38:17.851349 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.851995 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:17.853562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1453/2895] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:38:17 2022] DELETE /identity/v3/projects/6a448d933290472e93921b4a29bd187e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:17.857721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c0d5-e172-4b04-b7e2-631c39e9746c service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:17.864022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:17.868358 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c0d5-e172-4b04-b7e2-631c39e9746c service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:17.923063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:17.923950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:17.924226 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:17.924498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] PATH_INFO: `/v3/users/8352b2f6c4dd479d966da797e4e5b8bd` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:17.925661 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8352b2f6c4dd479d966da797e4e5b8bd)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:17.927687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:18.065561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8352b2f6c4dd479d966da797e4e5b8bd'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.134633 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8352b2f6c4dd479d966da797e4e5b8bd'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.146847 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8352b2f6c4dd479d966da797e4e5b8bd'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.147480 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8352b2f6c4dd479d966da797e4e5b8bd'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.154420 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-f1e5af49-b999-432e-b649-4e704ae7b717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8352b2f6c4dd479d966da797e4e5b8bd'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.160345 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1443/2896] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:38:17 2022] DELETE /identity/v3/users/8352b2f6c4dd479d966da797e4e5b8bd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:18.611312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:18.613852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:18.628680 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b30a7-0c65-4509-87a3-aad55abaaf53 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:18.687561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:18.688418 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:18.695424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:18.695424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] PATH_INFO: `/v3/projects/c1f8580699b947088ca396dcb827c234` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:18.695424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f8580699b947088ca396dcb827c234)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:18.695424 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:18.699891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:18.843812 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f8580699b947088ca396dcb827c234', 'request_id': 'req-bc841e2d-cf4e-47c2-be0c-98716be3f142'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.911985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f8580699b947088ca396dcb827c234', 'request_id': 'req-bc841e2d-cf4e-47c2-be0c-98716be3f142'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.919064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f8580699b947088ca396dcb827c234', 'request_id': 'req-bc841e2d-cf4e-47c2-be0c-98716be3f142'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.929468 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] The token cache is being invalidate because project c1f8580699b947088ca396dcb827c234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:38:18.929741 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.930453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-bc841e2d-cf4e-47c2-be0c-98716be3f142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:18.932007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1454/2897] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:38:18 2022] DELETE /identity/v3/projects/c1f8580699b947088ca396dcb827c234 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:38:18.937478 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8830-c813-418d-bcb6-3eedf491b9d1 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:18.937950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8830-c813-418d-bcb6-3eedf491b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:18.938056 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b8830-c813-418d-bcb6-3eedf491b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:18.975777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-dc9b8830-c813-418d-bcb6-3eedf491b9d1 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:18.976986 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-dc9b8830-c813-418d-bcb6-3eedf491b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:19.035731 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1444/2898] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:19.044003 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d6a21-1ab6-4482-ad8e-f512e7305a24 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.044293 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d6a21-1ab6-4482-ad8e-f512e7305a24 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.044575 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d6a21-1ab6-4482-ad8e-f512e7305a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.061818 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-358d6a21-1ab6-4482-ad8e-f512e7305a24 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:19.063043 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-358d6a21-1ab6-4482-ad8e-f512e7305a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:19.070870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1455/2899] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:19.075496 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b8830-c813-418d-bcb6-3eedf491b9d1 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:19.085302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b8830-c813-418d-bcb6-3eedf491b9d1 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:19.090498 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:19.091166 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.091452 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.091725 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] PATH_INFO: `/v3/domains` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.092438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:19.092740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:19.094335 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:19.096650 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:19.105929 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1445/2900] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:19.110198 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d6a21-1ab6-4482-ad8e-f512e7305a24 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:19.119533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d6a21-1ab6-4482-ad8e-f512e7305a24 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:19.124266 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335d5f-b4ee-4539-bc1a-6296cc7eb8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:19.124936 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335d5f-b4ee-4539-bc1a-6296cc7eb8ae admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.125221 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335d5f-b4ee-4539-bc1a-6296cc7eb8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.125497 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335d5f-b4ee-4539-bc1a-6296cc7eb8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.126237 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3335d5f-b4ee-4539-bc1a-6296cc7eb8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:19.128223 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3335d5f-b4ee-4539-bc1a-6296cc7eb8ae admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:19.252401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1456/2901] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:38:19 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:19.256655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:19.267490 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d5a67-fcdd-401d-8429-ba40eb1a89fd admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:19.324671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b51c9-7856-4ccb-a8ba-bbe814a1583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:19.325401 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b51c9-7856-4ccb-a8ba-bbe814a1583e admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.325691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b51c9-7856-4ccb-a8ba-bbe814a1583e admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.325972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b51c9-7856-4ccb-a8ba-bbe814a1583e admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.326712 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b51c9-7856-4ccb-a8ba-bbe814a1583e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:19.328671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b51c9-7856-4ccb-a8ba-bbe814a1583e admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:19.410492 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1446/2902] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:38:19 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:38:19.414576 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335d5f-b4ee-4539-bc1a-6296cc7eb8ae admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:19.425453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335d5f-b4ee-4539-bc1a-6296cc7eb8ae admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:19.430268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120c7c-1d35-41b9-a70f-5f5d9bb5b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:19.431031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120c7c-1d35-41b9-a70f-5f5d9bb5b1ec admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.431314 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120c7c-1d35-41b9-a70f-5f5d9bb5b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.431626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120c7c-1d35-41b9-a70f-5f5d9bb5b1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.432441 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08120c7c-1d35-41b9-a70f-5f5d9bb5b1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:19.434007 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08120c7c-1d35-41b9-a70f-5f5d9bb5b1ec admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:19.443787 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1457/2903] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:38:19.447674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b51c9-7856-4ccb-a8ba-bbe814a1583e admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:19.457819 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b51c9-7856-4ccb-a8ba-bbe814a1583e admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:19.463067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5d3e3-fa86-4dde-ba05-5f94d2ae2ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:19.463745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d3e3-fa86-4dde-ba05-5f94d2ae2ebc admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.464029 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d3e3-fa86-4dde-ba05-5f94d2ae2ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.464307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d3e3-fa86-4dde-ba05-5f94d2ae2ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.465031 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5d3e3-fa86-4dde-ba05-5f94d2ae2ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:19.466651 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5d3e3-fa86-4dde-ba05-5f94d2ae2ebc admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:19.476383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1447/2904] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:38:19.481059 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120c7c-1d35-41b9-a70f-5f5d9bb5b1ec admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:19.490783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120c7c-1d35-41b9-a70f-5f5d9bb5b1ec admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:19.495395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:19.496261 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.496546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.496820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] PATH_INFO: `/v3/projects/348d3f5c2cf247d3924d015b59ed4d39/users/309c4c0bb49b4ef9a0cbab825d210dda/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.511653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348d3f5c2cf247d3924d015b59ed4d39, user_id=309c4c0bb49b4ef9a0cbab825d210dda, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:19.514210 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:19.582083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1458/2905] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:38:19 2022] PUT /identity/v3/projects/348d3f5c2cf247d3924d015b59ed4d39/users/309c4c0bb49b4ef9a0cbab825d210dda/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:19.587747 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10789a6-2802-4613-85d0-b9c4e97e0f16 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.588039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10789a6-2802-4613-85d0-b9c4e97e0f16 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.588326 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10789a6-2802-4613-85d0-b9c4e97e0f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.605693 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b10789a6-2802-4613-85d0-b9c4e97e0f16 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:19.606943 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b10789a6-2802-4613-85d0-b9c4e97e0f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:19.664745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1448/2906] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:19.674309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:19.675994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:19.731678 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336278cd-e681-43d5-82b9-9027c6a20313 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:19.735315 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb08d9-71f3-4b8d-9424-ad8441d65f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:19.735958 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb08d9-71f3-4b8d-9424-ad8441d65f00 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:19.736244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb08d9-71f3-4b8d-9424-ad8441d65f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:19.736528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb08d9-71f3-4b8d-9424-ad8441d65f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:19.747425 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb08d9-71f3-4b8d-9424-ad8441d65f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:19.749070 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb08d9-71f3-4b8d-9424-ad8441d65f00 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:19.759146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1459/2907] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:38:24.624734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6786d0b-70dc-481a-ad91-629ced8539d9 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:24.625277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6786d0b-70dc-481a-ad91-629ced8539d9 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:24.625277 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6786d0b-70dc-481a-ad91-629ced8539d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:24.658930 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-f6786d0b-70dc-481a-ad91-629ced8539d9 None None] MFA Rules not processed for user `309c4c0bb49b4ef9a0cbab825d210dda`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:24.660274 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f6786d0b-70dc-481a-ad91-629ced8539d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:24.728924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1449/2908] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:38:24.733367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb08d9-71f3-4b8d-9424-ad8441d65f00 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:24.748478 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb08d9-71f3-4b8d-9424-ad8441d65f00 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:24.754040 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4e8f-eb2a-4748-98af-4ad056e3e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:24.754882 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4e8f-eb2a-4748-98af-4ad056e3e6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:24.755173 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4e8f-eb2a-4748-98af-4ad056e3e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:24.755474 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4e8f-eb2a-4748-98af-4ad056e3e6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:24.756166 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c4e8f-eb2a-4748-98af-4ad056e3e6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:24.758051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c4e8f-eb2a-4748-98af-4ad056e3e6d1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:24.859268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1460/2909] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:38:24 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:38:24.863363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6786d0b-70dc-481a-ad91-629ced8539d9 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:24.870844 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:24.876351 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6786d0b-70dc-481a-ad91-629ced8539d9 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:24.937491 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338314a-af50-4a43-b8d0-2612c10c3dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:24.938206 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338314a-af50-4a43-b8d0-2612c10c3dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:24.938500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338314a-af50-4a43-b8d0-2612c10c3dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:24.938787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338314a-af50-4a43-b8d0-2612c10c3dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:24.939487 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338314a-af50-4a43-b8d0-2612c10c3dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:24.941405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338314a-af50-4a43-b8d0-2612c10c3dd0 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:25.045631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1450/2910] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:38:24 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:25.049590 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4e8f-eb2a-4748-98af-4ad056e3e6d1 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:25.056972 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:25.061338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4e8f-eb2a-4748-98af-4ad056e3e6d1 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:25.065980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf76f-b6ce-48bb-960e-e24807b31d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:25.067115 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf76f-b6ce-48bb-960e-e24807b31d9f admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:25.067420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf76f-b6ce-48bb-960e-e24807b31d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:25.067708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf76f-b6ce-48bb-960e-e24807b31d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:25.068442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bf76f-b6ce-48bb-960e-e24807b31d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:25.070090 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bf76f-b6ce-48bb-960e-e24807b31d9f admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:25.083416 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1461/2911] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:38:25.087890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338314a-af50-4a43-b8d0-2612c10c3dd0 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:25.098236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338314a-af50-4a43-b8d0-2612c10c3dd0 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:25.103405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53aabb-cbcc-47a4-9fda-49e708033f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:25.104291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53aabb-cbcc-47a4-9fda-49e708033f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:25.104575 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53aabb-cbcc-47a4-9fda-49e708033f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:25.104855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53aabb-cbcc-47a4-9fda-49e708033f08 admin admin] PATH_INFO: `/v3/projects/2065ed87f4094a81bed9e009e04c618c/users/40597fcc092b460dac3ed8178c34087f/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:25.120165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53aabb-cbcc-47a4-9fda-49e708033f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2065ed87f4094a81bed9e009e04c618c, user_id=40597fcc092b460dac3ed8178c34087f, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:25.122870 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53aabb-cbcc-47a4-9fda-49e708033f08 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:25.176350 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1451/2912] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:38:25 2022] PUT /identity/v3/projects/2065ed87f4094a81bed9e009e04c618c/users/40597fcc092b460dac3ed8178c34087f/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:25.180410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf76f-b6ce-48bb-960e-e24807b31d9f admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:25.190899 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf76f-b6ce-48bb-960e-e24807b31d9f admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:25.247708 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3fd2-4da6-44b4-95f4-1b1f14ce4e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:25.248368 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3fd2-4da6-44b4-95f4-1b1f14ce4e4b admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:25.248652 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3fd2-4da6-44b4-95f4-1b1f14ce4e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:25.248931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3fd2-4da6-44b4-95f4-1b1f14ce4e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:25.249651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3fd2-4da6-44b4-95f4-1b1f14ce4e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:25.251285 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3fd2-4da6-44b4-95f4-1b1f14ce4e4b admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:25.261664 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1462/2913] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:38:25.266045 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53aabb-cbcc-47a4-9fda-49e708033f08 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:25.277310 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53aabb-cbcc-47a4-9fda-49e708033f08 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:25.282291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:25.283269 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:25.283623 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:25.284082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] PATH_INFO: `/v3/projects/2065ed87f4094a81bed9e009e04c618c/users/40597fcc092b460dac3ed8178c34087f/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:25.286199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2065ed87f4094a81bed9e009e04c618c, user_id=40597fcc092b460dac3ed8178c34087f, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:25.288862 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:25.301037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1452/2914] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:38:25 2022] PUT /identity/v3/projects/2065ed87f4094a81bed9e009e04c618c/users/40597fcc092b460dac3ed8178c34087f/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:30.933202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfa81d-ea03-42c7-9ed6-79af06ce85a5 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:30.933656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfa81d-ea03-42c7-9ed6-79af06ce85a5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:30.933765 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfa81d-ea03-42c7-9ed6-79af06ce85a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:30.961567 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-a1cfa81d-ea03-42c7-9ed6-79af06ce85a5 None None] MFA Rules not processed for user `40597fcc092b460dac3ed8178c34087f`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:30.963074 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a1cfa81d-ea03-42c7-9ed6-79af06ce85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:31.037865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1463/2915] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:31.054130 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:31.056589 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:31.136602 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f751-0c16-4c6f-945f-668fd9a89dfb admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:31.142179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb48b1-9d2c-40ce-8d85-519511b1555a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:31.142839 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb48b1-9d2c-40ce-8d85-519511b1555a service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:31.143122 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb48b1-9d2c-40ce-8d85-519511b1555a service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:31.143409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb48b1-9d2c-40ce-8d85-519511b1555a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:31.199329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:31.203192 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb48b1-9d2c-40ce-8d85-519511b1555a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:31.204833 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb48b1-9d2c-40ce-8d85-519511b1555a service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:31.215629 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1453/2916] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:38:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:38:33.748784 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a1c45-f82a-40ec-a464-f275c44d5a0a None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:33.749855 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a1c45-f82a-40ec-a464-f275c44d5a0a None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:33.750321 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a1c45-f82a-40ec-a464-f275c44d5a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:33.770826 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-790a1c45-f82a-40ec-a464-f275c44d5a0a None None] MFA Rules not processed for user `309c4c0bb49b4ef9a0cbab825d210dda`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:33.772392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-790a1c45-f82a-40ec-a464-f275c44d5a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:33.780645 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1464/2917] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:41.261440 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:43.764508 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=69 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:46.614027 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb48b1-9d2c-40ce-8d85-519511b1555a service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:46.667932 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb48b1-9d2c-40ce-8d85-519511b1555a service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:46.671450 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a5491-42bf-4821-9aae-85db8b202f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:46.672084 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a5491-42bf-4821-9aae-85db8b202f52 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:46.672363 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a5491-42bf-4821-9aae-85db8b202f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:46.672635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a5491-42bf-4821-9aae-85db8b202f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:46.682002 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a5491-42bf-4821-9aae-85db8b202f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:46.683443 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a5491-42bf-4821-9aae-85db8b202f52 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:46.692706 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1454/2918] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:38:56.688601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=26 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:44.070170 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a1c45-f82a-40ec-a464-f275c44d5a0a None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:44.071568 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-790a1c45-f82a-40ec-a464-f275c44d5a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:44.174410 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a1c45-f82a-40ec-a464-f275c44d5a0a None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:44.177996 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42bb727957e40dca943c47785819223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:44.178671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:44.178937 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:44.179211 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:44.180964 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:44.215062 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:44.216463 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:44.227157 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1465/2919] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:40:44.400072 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a5491-42bf-4821-9aae-85db8b202f52 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:44.419281 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a5491-42bf-4821-9aae-85db8b202f52 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:44.423035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1b1e4-edb6-403e-861b-225aea763366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:44.423671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b1e4-edb6-403e-861b-225aea763366 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:44.423959 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b1e4-edb6-403e-861b-225aea763366 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:44.424240 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b1e4-edb6-403e-861b-225aea763366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:44.425992 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-57d1b1e4-edb6-403e-861b-225aea763366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:44.436317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1b1e4-edb6-403e-861b-225aea763366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:44.437783 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1b1e4-edb6-403e-861b-225aea763366 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:44.446236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1455/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:40:44.580785 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:44.582288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:44.594732 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fee19-13ec-4232-9fe9-2962b614bc73 service glance] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:44.598931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:44.599588 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:44.600302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:44.600302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:44.601980 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:44.616759 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:44.620162 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:44.630052 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1466/2921] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:40:54.442680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=11 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:54.624600 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=63 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:57.985758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520aaf3-792a-40bc-b3f1-dd405c4b4b84 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:57.992588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520aaf3-792a-40bc-b3f1-dd405c4b4b84 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:57.992588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520aaf3-792a-40bc-b3f1-dd405c4b4b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:58.035089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-1520aaf3-792a-40bc-b3f1-dd405c4b4b84 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:58.036290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-1520aaf3-792a-40bc-b3f1-dd405c4b4b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:58.099837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1456/2922] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:40:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:40:58.239563 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:58.240983 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:58.331122 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358de4f-aed4-4f39-aa78-6eddafe9dfc7 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:58.337116 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bf6aa-d6a6-4257-82ab-f009ce752c3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:58.337947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bf6aa-d6a6-4257-82ab-f009ce752c3c service swift] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:58.338278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bf6aa-d6a6-4257-82ab-f009ce752c3c service swift] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:58.339144 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bf6aa-d6a6-4257-82ab-f009ce752c3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:58.347939 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bf6aa-d6a6-4257-82ab-f009ce752c3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:58.349608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bf6aa-d6a6-4257-82ab-f009ce752c3c service swift] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:58.358451 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1467/2923] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:40:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:41:08.096931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=40 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:08.354533 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=41 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:12.123938 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c43519-dca3-4fe3-b27f-f9d47d6f80d6 None None] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:12.124514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c43519-dca3-4fe3-b27f-f9d47d6f80d6 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:12.124514 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c43519-dca3-4fe3-b27f-f9d47d6f80d6 None None] PATH_INFO: `/` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:12.125860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1457/2924] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:41:12.131703 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a1f5-8a9d-4efb-8f1a-1b679424eb34 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:12.132227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a1f5-8a9d-4efb-8f1a-1b679424eb34 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:12.132344 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a1f5-8a9d-4efb-8f1a-1b679424eb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:12.169306 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-8340a1f5-8a9d-4efb-8f1a-1b679424eb34 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:12.170554 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-8340a1f5-8a9d-4efb-8f1a-1b679424eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:12.180018 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1468/2925] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:41:12.191556 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c43519-dca3-4fe3-b27f-f9d47d6f80d6 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:12.203249 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c43519-dca3-4fe3-b27f-f9d47d6f80d6 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:12.206727 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba4066-c791-4a8c-9808-1c91c710f043 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42bb727957e40dca943c47785819223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:12.207359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba4066-c791-4a8c-9808-1c91c710f043 service glance] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:12.207639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba4066-c791-4a8c-9808-1c91c710f043 service glance] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:12.207912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba4066-c791-4a8c-9808-1c91c710f043 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:12.218550 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba4066-c791-4a8c-9808-1c91c710f043 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:12.219961 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba4066-c791-4a8c-9808-1c91c710f043 service glance] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:12.232617 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1458/2926] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:12.447224 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11a8c-6893-4edc-a11d-acd9769e02f3 None None] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:12.447515 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11a8c-6893-4edc-a11d-acd9769e02f3 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:12.447795 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11a8c-6893-4edc-a11d-acd9769e02f3 None None] PATH_INFO: `/` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:12.449288 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1469/2927] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jul 11 15:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:12.454446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df97ed-7dc8-432d-9a0e-0d2f37c50eab None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:12.454734 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df97ed-7dc8-432d-9a0e-0d2f37c50eab None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:12.455014 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df97ed-7dc8-432d-9a0e-0d2f37c50eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:12.501854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-d8df97ed-7dc8-432d-9a0e-0d2f37c50eab None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:12.503102 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d8df97ed-7dc8-432d-9a0e-0d2f37c50eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:12.509518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1459/2928] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:41:12.521420 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11a8c-6893-4edc-a11d-acd9769e02f3 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:12.533060 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11a8c-6893-4edc-a11d-acd9769e02f3 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:12.536549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d36d8-083a-42fa-b778-e7d96da57b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:12.537179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d36d8-083a-42fa-b778-e7d96da57b7f service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:12.537492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d36d8-083a-42fa-b778-e7d96da57b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:12.537770 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d36d8-083a-42fa-b778-e7d96da57b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:12.545382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d36d8-083a-42fa-b778-e7d96da57b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:12.546834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d36d8-083a-42fa-b778-e7d96da57b7f service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:12.554668 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1470/2929] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:12.636161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df97ed-7dc8-432d-9a0e-0d2f37c50eab None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:12.645461 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df97ed-7dc8-432d-9a0e-0d2f37c50eab None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:12.649004 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:12.649632 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:12.649909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:12.650286 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:12.652652 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:12.665547 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:12.666980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:12.677639 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1460/2930] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:14.719067 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc34a5-bb8a-4d95-a59a-958d3a59939b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:14.719549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc34a5-bb8a-4d95-a59a-958d3a59939b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:14.719656 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc34a5-bb8a-4d95-a59a-958d3a59939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:14.737670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c9bc34a5-bb8a-4d95-a59a-958d3a59939b None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:14.738945 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c9bc34a5-bb8a-4d95-a59a-958d3a59939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:14.746377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1471/2931] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:41:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:14.758161 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:14.769570 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63932486-9a7f-40c7-817d-50047f433a5b service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:14.774535 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23e6c-8c41-4e27-900f-4867c32b68cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:14.775199 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23e6c-8c41-4e27-900f-4867c32b68cd service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:14.775483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23e6c-8c41-4e27-900f-4867c32b68cd service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:14.775761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23e6c-8c41-4e27-900f-4867c32b68cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:14.784307 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b23e6c-8c41-4e27-900f-4867c32b68cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:14.785891 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b23e6c-8c41-4e27-900f-4867c32b68cd service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:14.794619 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1461/2932] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:41:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:41:24.732740 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=18 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:24.790719 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=27 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:30.317098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474f83-422b-4994-a228-2fb264fca111 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.317549 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474f83-422b-4994-a228-2fb264fca111 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.317751 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474f83-422b-4994-a228-2fb264fca111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.335028 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-98474f83-422b-4994-a228-2fb264fca111 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:30.336203 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-98474f83-422b-4994-a228-2fb264fca111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:30.343746 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1472/2933] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jul 11 15:41:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:30.356147 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23e6c-8c41-4e27-900f-4867c32b68cd service swift] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:30.366850 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23e6c-8c41-4e27-900f-4867c32b68cd service swift] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:30.371808 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67a93a-5525-49ca-a34b-63617673042f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:30.372444 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a93a-5525-49ca-a34b-63617673042f service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.372729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a93a-5525-49ca-a34b-63617673042f service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.373006 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a93a-5525-49ca-a34b-63617673042f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.381030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67a93a-5525-49ca-a34b-63617673042f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:30.382631 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67a93a-5525-49ca-a34b-63617673042f service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:30.390752 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1462/2934] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:41:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:41:40.330053 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:40.387489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:46.313381 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98474f83-422b-4994-a228-2fb264fca111 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:46.314846 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-98474f83-422b-4994-a228-2fb264fca111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:46.402452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98474f83-422b-4994-a228-2fb264fca111 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:46.407256 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:46.407898 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:46.408178 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:46.408452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:46.410282 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:46.421969 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:46.423553 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:46.433842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1473/2935] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:56.429179 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=41 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:43.537105 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67a93a-5525-49ca-a34b-63617673042f service swift] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:43.551153 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67a93a-5525-49ca-a34b-63617673042f service swift] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:43.557155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480efe0-c4db-4a8c-a124-3c3a15c921bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:43.557818 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480efe0-c4db-4a8c-a124-3c3a15c921bd service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:43.558126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480efe0-c4db-4a8c-a124-3c3a15c921bd service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:43.558415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480efe0-c4db-4a8c-a124-3c3a15c921bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:43.560264 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-a480efe0-c4db-4a8c-a124-3c3a15c921bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:43.574764 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480efe0-c4db-4a8c-a124-3c3a15c921bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:43.578997 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480efe0-c4db-4a8c-a124-3c3a15c921bd service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:43.588386 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1463/2936] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:45.842987 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:45.855366 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159bbe-fbfd-49a5-9f0a-2a330e95e504 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:45.861529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01d188-609f-4777-8239-078150abc385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:45.862234 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d188-609f-4777-8239-078150abc385 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:45.862565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d188-609f-4777-8239-078150abc385 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:45.862834 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d188-609f-4777-8239-078150abc385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:45.864625 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6a01d188-609f-4777-8239-078150abc385 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:45.877395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01d188-609f-4777-8239-078150abc385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:45.881202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01d188-609f-4777-8239-078150abc385 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:45.889608 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1474/2937] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:51.255810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936709-e36d-4d5e-ae40-d5ae16a445fe None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:51.256333 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936709-e36d-4d5e-ae40-d5ae16a445fe None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:51.256501 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936709-e36d-4d5e-ae40-d5ae16a445fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:51.273576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-da936709-e36d-4d5e-ae40-d5ae16a445fe None None] MFA Rules not processed for user `309c4c0bb49b4ef9a0cbab825d210dda`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:51.274812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-da936709-e36d-4d5e-ae40-d5ae16a445fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:51.281777 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1464/2938] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:55.885112 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:01.268967 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=9 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:13.417010 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab3c5c-a7ca-425f-9da1-4af0eac63de2 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:13.417589 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab3c5c-a7ca-425f-9da1-4af0eac63de2 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:13.417698 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab3c5c-a7ca-425f-9da1-4af0eac63de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:13.448379 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c4ab3c5c-a7ca-425f-9da1-4af0eac63de2 None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:13.449839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c4ab3c5c-a7ca-425f-9da1-4af0eac63de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:13.465715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1475/2939] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Jul 11 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:13.471560 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da936709-e36d-4d5e-ae40-d5ae16a445fe None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:13.480940 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da936709-e36d-4d5e-ae40-d5ae16a445fe None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:13.484438 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:13.485061 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:13.485340 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:13.485610 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:13.487319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:13.497086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:13.498527 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:13.507042 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1465/2940] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:14.322357 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ae474-56b1-4e33-9ea3-48526afdecb5 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:14.322773 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ae474-56b1-4e33-9ea3-48526afdecb5 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:14.323057 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ae474-56b1-4e33-9ea3-48526afdecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:14.341903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-b57ae474-56b1-4e33-9ea3-48526afdecb5 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:14.343158 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b57ae474-56b1-4e33-9ea3-48526afdecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:14.352581 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1476/2941] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:43:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:43:14.364854 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:14.366463 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:14.382761 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce147d-3b54-4518-8eb9-3d730a78f3f9 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:14.386658 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8e4d8-ec6d-4c5b-bcdd-d166263c5e7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:14.387359 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e4d8-ec6d-4c5b-bcdd-d166263c5e7c service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:14.387657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e4d8-ec6d-4c5b-bcdd-d166263c5e7c service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:14.387957 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e4d8-ec6d-4c5b-bcdd-d166263c5e7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:14.397188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8e4d8-ec6d-4c5b-bcdd-d166263c5e7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:14.399536 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8e4d8-ec6d-4c5b-bcdd-d166263c5e7c service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:14.408842 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1466/2942] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:24.338475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=15 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:24.404730 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=12 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:31.679340 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ae474-56b1-4e33-9ea3-48526afdecb5 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:31.692334 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ae474-56b1-4e33-9ea3-48526afdecb5 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:31.697750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af10a99-9d18-47ba-accc-48f3361af723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:31.698694 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af10a99-9d18-47ba-accc-48f3361af723 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.698976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af10a99-9d18-47ba-accc-48f3361af723 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.699249 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af10a99-9d18-47ba-accc-48f3361af723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.706961 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af10a99-9d18-47ba-accc-48f3361af723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:31.708528 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af10a99-9d18-47ba-accc-48f3361af723 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:31.717192 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1477/2943] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:33.201635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8e4d8-ec6d-4c5b-bcdd-d166263c5e7c service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.215076 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8e4d8-ec6d-4c5b-bcdd-d166263c5e7c service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.220837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.221453 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.221745 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.222022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.223849 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:33.236258 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.237983 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.250095 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1467/2944] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:41.713305 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:43.245126 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:49.200506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6a27-a714-49d3-9ffb-b6e423145a2f None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:49.201071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6a27-a714-49d3-9ffb-b6e423145a2f None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:49.201071 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6a27-a714-49d3-9ffb-b6e423145a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:49.238732 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c03c6a27-a714-49d3-9ffb-b6e423145a2f None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:49.239949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c03c6a27-a714-49d3-9ffb-b6e423145a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:49.246466 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1478/2945] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Jul 11 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:49.252319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:49.262188 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc73a4a-c975-4ce1-b0d8-5087ef27bfa6 service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:49.265721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4570f1-d58b-43aa-ad2a-e9d7561b9775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:49.266396 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4570f1-d58b-43aa-ad2a-e9d7561b9775 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:49.266680 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4570f1-d58b-43aa-ad2a-e9d7561b9775 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:49.266955 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4570f1-d58b-43aa-ad2a-e9d7561b9775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:49.275011 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4570f1-d58b-43aa-ad2a-e9d7561b9775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:49.281729 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4570f1-d58b-43aa-ad2a-e9d7561b9775 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:49.284304 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1468/2946] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:59.233910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=11 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:59.280748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:04.062251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c6a27-a714-49d3-9ffb-b6e423145a2f None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:04.070184 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c6a27-a714-49d3-9ffb-b6e423145a2f None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:04.074931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f913ea9-a04e-42ed-8435-2b97f13c8ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:04.074931 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f913ea9-a04e-42ed-8435-2b97f13c8ddc service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:04.075168 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f913ea9-a04e-42ed-8435-2b97f13c8ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:04.075343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f913ea9-a04e-42ed-8435-2b97f13c8ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:04.092896 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f913ea9-a04e-42ed-8435-2b97f13c8ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:04.094342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f913ea9-a04e-42ed-8435-2b97f13c8ddc service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:04.116008 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1479/2947] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:05.291912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4570f1-d58b-43aa-ad2a-e9d7561b9775 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:05.300962 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4570f1-d58b-43aa-ad2a-e9d7561b9775 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:05.304626 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869aa9e-1033-49d9-a765-f759d653cfb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:05.305261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869aa9e-1033-49d9-a765-f759d653cfb8 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:05.305545 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869aa9e-1033-49d9-a765-f759d653cfb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:05.305822 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869aa9e-1033-49d9-a765-f759d653cfb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:05.316786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869aa9e-1033-49d9-a765-f759d653cfb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:05.318366 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869aa9e-1033-49d9-a765-f759d653cfb8 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:05.329601 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1469/2948] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:14.113251 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=13 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:15.324806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:20.067363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f913ea9-a04e-42ed-8435-2b97f13c8ddc service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:20.076404 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f913ea9-a04e-42ed-8435-2b97f13c8ddc service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:20.080064 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf2c9-1fb1-415c-b40f-e308298dae37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:20.080715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf2c9-1fb1-415c-b40f-e308298dae37 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:20.081232 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf2c9-1fb1-415c-b40f-e308298dae37 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:20.081514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf2c9-1fb1-415c-b40f-e308298dae37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:20.089829 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbf2c9-1fb1-415c-b40f-e308298dae37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:20.091401 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbf2c9-1fb1-415c-b40f-e308298dae37 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:20.099867 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1480/2949] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:20.192813 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869aa9e-1033-49d9-a765-f759d653cfb8 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:20.207473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869aa9e-1033-49d9-a765-f759d653cfb8 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:20.207473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:20.207473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:20.207473 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:20.208007 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:20.217965 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:20.219457 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:20.230325 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1470/2950] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:30.096098 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:30.225549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:51.316689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf2c9-1fb1-415c-b40f-e308298dae37 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:51.329651 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf2c9-1fb1-415c-b40f-e308298dae37 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:51.334596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797625a4-20bd-4965-860d-14666bcaab1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:51.335227 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797625a4-20bd-4965-860d-14666bcaab1f service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:51.335514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797625a4-20bd-4965-860d-14666bcaab1f service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:51.335794 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797625a4-20bd-4965-860d-14666bcaab1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:51.344317 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797625a4-20bd-4965-860d-14666bcaab1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:51.345935 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797625a4-20bd-4965-860d-14666bcaab1f service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:51.355767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1481/2951] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:01.351628 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:16.481855 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:16.483488 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:16.513691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2a9fa-d94a-437a-b859-2598be3e92a7 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:16.520395 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7945d-67cc-4a66-9aa1-4c92a442be6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:16.521515 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7945d-67cc-4a66-9aa1-4c92a442be6b service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:16.521901 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7945d-67cc-4a66-9aa1-4c92a442be6b service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:16.522338 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7945d-67cc-4a66-9aa1-4c92a442be6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:16.534039 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7945d-67cc-4a66-9aa1-4c92a442be6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:16.535812 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7945d-67cc-4a66-9aa1-4c92a442be6b service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:16.548155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1471/2952] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:48:23.830642 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bb986-cf4b-4d45-baa4-2fb63ebac39b None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:23.831222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bb986-cf4b-4d45-baa4-2fb63ebac39b None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:23.831222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bb986-cf4b-4d45-baa4-2fb63ebac39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:23.869613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-c23bb986-cf4b-4d45-baa4-2fb63ebac39b None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:23.870875 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-c23bb986-cf4b-4d45-baa4-2fb63ebac39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:23.879979 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1482/2953] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Jul 11 15:48:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:23.894549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e0110-ceb1-477c-8843-e5e740394c32 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:23.894549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e0110-ceb1-477c-8843-e5e740394c32 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:23.894549 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e0110-ceb1-477c-8843-e5e740394c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:23.910298 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-ee2e0110-ceb1-477c-8843-e5e740394c32 None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:23.911571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-ee2e0110-ceb1-477c-8843-e5e740394c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:23.920193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1472/2954] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Jul 11 15:48:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:23.926611 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bb986-cf4b-4d45-baa4-2fb63ebac39b None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:23.937904 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bb986-cf4b-4d45-baa4-2fb63ebac39b None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:23.943343 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f443e2-5e02-468e-8191-b8ddb1be724a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:23.944019 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f443e2-5e02-468e-8191-b8ddb1be724a service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:23.944302 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f443e2-5e02-468e-8191-b8ddb1be724a service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:23.944579 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f443e2-5e02-468e-8191-b8ddb1be724a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:23.953860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f443e2-5e02-468e-8191-b8ddb1be724a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:23.955479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f443e2-5e02-468e-8191-b8ddb1be724a service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:23.965514 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1483/2955] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:48:26.155407 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e0110-ceb1-477c-8843-e5e740394c32 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:26.165468 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e0110-ceb1-477c-8843-e5e740394c32 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:26.170922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:26.170922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:26.170922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:26.170922 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:26.172346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:26.258178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:26.259634 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:26.279205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1473/2956] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:29.802516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f443e2-5e02-468e-8191-b8ddb1be724a service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:29.813262 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f443e2-5e02-468e-8191-b8ddb1be724a service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:29.818845 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:29.819545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:29.819839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:29.820125 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:29.821921 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:29.833994 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:29.836355 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:29.847244 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1484/2957] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:33.151618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:33.163030 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5670262-ee5a-4cc4-80eb-90f9235b373a service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:33.168035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:33.168687 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:33.168972 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:33.169255 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:33.171086 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:33.183078 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:33.184596 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:33.195991 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1474/2958] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:33.264458 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:33.266127 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:33.281085 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc6a22-81af-4c4d-b954-f6457e5003e8 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:33.285644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:33.286571 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:33.289783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:33.289783 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] PATH_INFO: `/v3/users/309c4c0bb49b4ef9a0cbab825d210dda` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:33.301202 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=309c4c0bb49b4ef9a0cbab825d210dda)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:33.303151 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:33.522970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309c4c0bb49b4ef9a0cbab825d210dda'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:33.611658 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309c4c0bb49b4ef9a0cbab825d210dda'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:33.624558 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309c4c0bb49b4ef9a0cbab825d210dda'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:33.631479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309c4c0bb49b4ef9a0cbab825d210dda'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:33.632123 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309c4c0bb49b4ef9a0cbab825d210dda'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:33.638774 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1485/2959] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:48:33 2022] DELETE /identity/v3/users/309c4c0bb49b4ef9a0cbab825d210dda => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:48:33.887909 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:33.900748 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8407a6-6891-4e30-a2ea-14823f9774c1 service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:33.964179 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:33.965091 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:33.965405 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:33.965683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] PATH_INFO: `/v3/projects/348d3f5c2cf247d3924d015b59ed4d39` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:33.976830 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=348d3f5c2cf247d3924d015b59ed4d39)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:33.978784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:33.995409 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:34.084934 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348d3f5c2cf247d3924d015b59ed4d39', 'request_id': 'req-9d8f9170-4f22-4583-b85c-78d8b335e13c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.143205 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348d3f5c2cf247d3924d015b59ed4d39', 'request_id': 'req-9d8f9170-4f22-4583-b85c-78d8b335e13c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.149500 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348d3f5c2cf247d3924d015b59ed4d39', 'request_id': 'req-9d8f9170-4f22-4583-b85c-78d8b335e13c'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.161843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] The token cache is being invalidate because project 348d3f5c2cf247d3924d015b59ed4d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:48:34.162459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.162803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.165067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1475/2960] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:48:33 2022] DELETE /identity/v3/projects/348d3f5c2cf247d3924d015b59ed4d39 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:48:34.169111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:34.170650 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:34.184492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba13c-55a9-427e-adc2-bdcd515298ac admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:34.243212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:34.244124 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:34.244429 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:34.244717 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] PATH_INFO: `/v3/users/40597fcc092b460dac3ed8178c34087f` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:34.258641 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40597fcc092b460dac3ed8178c34087f)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:34.260689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:34.265472 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:34.466135 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40597fcc092b460dac3ed8178c34087f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.526283 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40597fcc092b460dac3ed8178c34087f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.539667 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40597fcc092b460dac3ed8178c34087f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.546449 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40597fcc092b460dac3ed8178c34087f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.547094 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-840c5c98-dfc5-484f-b243-76784c4938b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40597fcc092b460dac3ed8178c34087f'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:34.553017 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1486/2961] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:48:34 2022] DELETE /identity/v3/users/40597fcc092b460dac3ed8178c34087f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:48:34.784523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:34.786081 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:34.799483 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f9170-4f22-4583-b85c-78d8b335e13c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:34.859717 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:34.863669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:34.863669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:34.863669 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] PATH_INFO: `/v3/projects/2065ed87f4094a81bed9e009e04c618c` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:34.872291 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2065ed87f4094a81bed9e009e04c618c)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:34.874302 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:34.955829 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2065ed87f4094a81bed9e009e04c618c', 'request_id': 'req-a19d17e7-9e96-45a9-8404-5b4c743247f4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:35.006156 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2065ed87f4094a81bed9e009e04c618c', 'request_id': 'req-a19d17e7-9e96-45a9-8404-5b4c743247f4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:35.013415 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2065ed87f4094a81bed9e009e04c618c', 'request_id': 'req-a19d17e7-9e96-45a9-8404-5b4c743247f4'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:35.025677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] The token cache is being invalidate because project 2065ed87f4094a81bed9e009e04c618c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:48:35.025964 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:35.026641 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a19d17e7-9e96-45a9-8404-5b4c743247f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:48:35.028203 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1476/2962] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:48:34 2022] DELETE /identity/v3/projects/2065ed87f4094a81bed9e009e04c618c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:48:35.033154 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9711-f508-40e0-bd61-86351f4de403 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.033445 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9711-f508-40e0-bd61-86351f4de403 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.033718 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9711-f508-40e0-bd61-86351f4de403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.080909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-570f9711-f508-40e0-bd61-86351f4de403 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:35.082301 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-570f9711-f508-40e0-bd61-86351f4de403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:35.142077 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1487/2963] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:35.149928 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797635cf-69c1-418d-b9d2-e3bf06f9780d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.150257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797635cf-69c1-418d-b9d2-e3bf06f9780d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.150542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797635cf-69c1-418d-b9d2-e3bf06f9780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.169270 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-797635cf-69c1-418d-b9d2-e3bf06f9780d None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:35.170513 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-797635cf-69c1-418d-b9d2-e3bf06f9780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:35.178470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1477/2964] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:35.183065 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f9711-f508-40e0-bd61-86351f4de403 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:35.192615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f9711-f508-40e0-bd61-86351f4de403 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:35.198068 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:35.198750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.199036 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.199312 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] PATH_INFO: `/v3/domains` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.200031 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:48:35.200338 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:35.201907 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:35.213596 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1488/2965] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jul 11 15:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:48:35.217970 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797635cf-69c1-418d-b9d2-e3bf06f9780d None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:35.227879 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797635cf-69c1-418d-b9d2-e3bf06f9780d None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:35.232758 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f52899-a2ee-43f8-9f3e-b00c8be4d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:35.233518 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52899-a2ee-43f8-9f3e-b00c8be4d5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.233860 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52899-a2ee-43f8-9f3e-b00c8be4d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.234235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52899-a2ee-43f8-9f3e-b00c8be4d5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.235003 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f52899-a2ee-43f8-9f3e-b00c8be4d5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:35.236980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f52899-a2ee-43f8-9f3e-b00c8be4d5e3 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:35.252590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:35.377523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1478/2966] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:48:35 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:48:35.381816 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:35.391804 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a43b14-a61a-471c-a81f-7e38ba8cf434 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:35.436045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:35.447781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b3fe-7a38-4de7-b6fb-ad7abe16c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:35.451199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b3fe-7a38-4de7-b6fb-ad7abe16c3ba admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.451199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b3fe-7a38-4de7-b6fb-ad7abe16c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.451199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b3fe-7a38-4de7-b6fb-ad7abe16c3ba admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.451199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39b3fe-7a38-4de7-b6fb-ad7abe16c3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:35.451565 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39b3fe-7a38-4de7-b6fb-ad7abe16c3ba admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:35.525886 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1489/2967] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:48:35 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:48:35.529599 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f52899-a2ee-43f8-9f3e-b00c8be4d5e3 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:35.540411 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f52899-a2ee-43f8-9f3e-b00c8be4d5e3 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:35.545016 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19689e6b-af4d-4c08-a1a0-bfd20279181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:35.545666 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19689e6b-af4d-4c08-a1a0-bfd20279181c admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.545950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19689e6b-af4d-4c08-a1a0-bfd20279181c admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.546253 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19689e6b-af4d-4c08-a1a0-bfd20279181c admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.546984 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19689e6b-af4d-4c08-a1a0-bfd20279181c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:35.548571 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19689e6b-af4d-4c08-a1a0-bfd20279181c admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:35.559319 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1479/2968] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:48:35.563247 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b3fe-7a38-4de7-b6fb-ad7abe16c3ba admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:35.573294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b3fe-7a38-4de7-b6fb-ad7abe16c3ba admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:35.577918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed06c9-c14c-4f7b-824e-153db2fa6874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:35.578604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed06c9-c14c-4f7b-824e-153db2fa6874 admin admin] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.578895 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed06c9-c14c-4f7b-824e-153db2fa6874 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.579172 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed06c9-c14c-4f7b-824e-153db2fa6874 admin admin] PATH_INFO: `/v3/roles` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.579889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed06c9-c14c-4f7b-824e-153db2fa6874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:35.581453 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed06c9-c14c-4f7b-824e-153db2fa6874 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:35.591610 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1490/2969] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:48:35.595524 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19689e6b-af4d-4c08-a1a0-bfd20279181c admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:35.605915 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19689e6b-af4d-4c08-a1a0-bfd20279181c admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:35.610546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:35.611406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.611691 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.611969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] PATH_INFO: `/v3/projects/04a4e75acf2b47c0911f5e9a803ae817/users/9c34e002e19c4a31920483dffc686b68/roles/20ef9cdb3c3c4a79bfacad902829d018` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.627037 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a4e75acf2b47c0911f5e9a803ae817, user_id=9c34e002e19c4a31920483dffc686b68, role_id=20ef9cdb3c3c4a79bfacad902829d018)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:35.629674 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:35.697566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1480/2970] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:48:35 2022] PUT /identity/v3/projects/04a4e75acf2b47c0911f5e9a803ae817/users/9c34e002e19c4a31920483dffc686b68/roles/20ef9cdb3c3c4a79bfacad902829d018 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:48:35.709505 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795785-7656-47df-a54d-7d5212a6db15 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.709691 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795785-7656-47df-a54d-7d5212a6db15 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.709973 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795785-7656-47df-a54d-7d5212a6db15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.728421 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-0e795785-7656-47df-a54d-7d5212a6db15 None None] MFA Rules not processed for user `93482eec3eb5456081aa49110195cd04`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:35.729620 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-0e795785-7656-47df-a54d-7d5212a6db15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:35.787670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1491/2971] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:35.797807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:35.799525 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:35.855020 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc2fe5-e6aa-4c79-a100-471a10de4fe6 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:35.858648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21de94-83aa-4db6-bf8e-b62cf431e8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:35.859279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21de94-83aa-4db6-bf8e-b62cf431e8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:35.859561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21de94-83aa-4db6-bf8e-b62cf431e8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:35.859837 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21de94-83aa-4db6-bf8e-b62cf431e8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:35.868648 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21de94-83aa-4db6-bf8e-b62cf431e8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:35.870063 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21de94-83aa-4db6-bf8e-b62cf431e8a1 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:35.879428 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1481/2972] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:41.233236 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ff8a-8bd1-42a1-86fd-e42c93c8caa8 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:41.233833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ff8a-8bd1-42a1-86fd-e42c93c8caa8 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:41.233833 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ff8a-8bd1-42a1-86fd-e42c93c8caa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:41.264920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-f4c3ff8a-8bd1-42a1-86fd-e42c93c8caa8 None None] MFA Rules not processed for user `9c34e002e19c4a31920483dffc686b68`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:41.265721 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f4c3ff8a-8bd1-42a1-86fd-e42c93c8caa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:41.337442 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1492/2973] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:48:41.345867 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21de94-83aa-4db6-bf8e-b62cf431e8a1 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:41.356172 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21de94-83aa-4db6-bf8e-b62cf431e8a1 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:41.365784 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90861a5-ec9c-4673-9ddc-2c5a0b28a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:41.366588 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90861a5-ec9c-4673-9ddc-2c5a0b28a803 admin admin] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:41.366944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90861a5-ec9c-4673-9ddc-2c5a0b28a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:41.367292 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90861a5-ec9c-4673-9ddc-2c5a0b28a803 admin admin] PATH_INFO: `/v3/projects` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:41.368111 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90861a5-ec9c-4673-9ddc-2c5a0b28a803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:41.370141 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90861a5-ec9c-4673-9ddc-2c5a0b28a803 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:41.477321 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1482/2974] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jul 11 15:48:41 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:48:41.478685 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ff8a-8bd1-42a1-86fd-e42c93c8caa8 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:41.490045 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ff8a-8bd1-42a1-86fd-e42c93c8caa8 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:41.548778 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:41.557326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64975fe0-006f-4a1b-a3ad-c874fb92f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:41.557326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64975fe0-006f-4a1b-a3ad-c874fb92f8fe admin admin] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:41.557326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64975fe0-006f-4a1b-a3ad-c874fb92f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:41.557326 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64975fe0-006f-4a1b-a3ad-c874fb92f8fe admin admin] PATH_INFO: `/v3/users` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:41.557860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64975fe0-006f-4a1b-a3ad-c874fb92f8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:41.558910 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64975fe0-006f-4a1b-a3ad-c874fb92f8fe admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:41.661336 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1493/2975] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jul 11 15:48:41 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:48:41.665398 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90861a5-ec9c-4673-9ddc-2c5a0b28a803 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:41.675820 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90861a5-ec9c-4673-9ddc-2c5a0b28a803 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:41.680766 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613754-0983-4cb9-bcb6-cab486ae6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:41.682614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613754-0983-4cb9-bcb6-cab486ae6a97 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:41.682614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613754-0983-4cb9-bcb6-cab486ae6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:41.682614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613754-0983-4cb9-bcb6-cab486ae6a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:41.682945 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7613754-0983-4cb9-bcb6-cab486ae6a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:41.684572 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7613754-0983-4cb9-bcb6-cab486ae6a97 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:41.696136 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1483/2976] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:48:41.700145 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64975fe0-006f-4a1b-a3ad-c874fb92f8fe admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:41.709947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64975fe0-006f-4a1b-a3ad-c874fb92f8fe admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:41.715199 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01cca3-bd31-479e-b85f-048c8051ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:41.716051 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01cca3-bd31-479e-b85f-048c8051ceda admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:41.716331 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01cca3-bd31-479e-b85f-048c8051ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:41.716604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01cca3-bd31-479e-b85f-048c8051ceda admin admin] PATH_INFO: `/v3/projects/305255994aa844b394de283103f4df50/users/f90bc834d17d440dbebeacfbeb7f08b8/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:41.730842 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01cca3-bd31-479e-b85f-048c8051ceda admin admin] RBAC: Authorizing `identity:create_grant(project_id=305255994aa844b394de283103f4df50, user_id=f90bc834d17d440dbebeacfbeb7f08b8, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:41.733462 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01cca3-bd31-479e-b85f-048c8051ceda admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:41.810934 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1494/2977] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:48:41 2022] PUT /identity/v3/projects/305255994aa844b394de283103f4df50/users/f90bc834d17d440dbebeacfbeb7f08b8/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:48:41.814897 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613754-0983-4cb9-bcb6-cab486ae6a97 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:41.825887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613754-0983-4cb9-bcb6-cab486ae6a97 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:41.882127 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd375dad-ad59-471d-8307-d49c6fde1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:41.882803 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd375dad-ad59-471d-8307-d49c6fde1e70 admin admin] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:41.883089 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd375dad-ad59-471d-8307-d49c6fde1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:41.883931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd375dad-ad59-471d-8307-d49c6fde1e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:41.884671 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd375dad-ad59-471d-8307-d49c6fde1e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:41.886346 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd375dad-ad59-471d-8307-d49c6fde1e70 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:41.896036 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1484/2978] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jul 11 15:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:48:41.900293 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01cca3-bd31-479e-b85f-048c8051ceda admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:41.910730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01cca3-bd31-479e-b85f-048c8051ceda admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:41.915492 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:41.916382 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] REQUEST_METHOD: `PUT` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:41.916671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:41.916993 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] PATH_INFO: `/v3/projects/305255994aa844b394de283103f4df50/users/f90bc834d17d440dbebeacfbeb7f08b8/roles/aa5917344d8b4ee78bcb09ec5cb6c179` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:41.919268 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=305255994aa844b394de283103f4df50, user_id=f90bc834d17d440dbebeacfbeb7f08b8, role_id=aa5917344d8b4ee78bcb09ec5cb6c179)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:41.921917 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:41.933918 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1495/2979] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jul 11 15:48:41 2022] PUT /identity/v3/projects/305255994aa844b394de283103f4df50/users/f90bc834d17d440dbebeacfbeb7f08b8/roles/aa5917344d8b4ee78bcb09ec5cb6c179 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:48:47.510613 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31486b7e-069e-44bb-a8e5-49943e36110e None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:47.511132 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31486b7e-069e-44bb-a8e5-49943e36110e None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:47.511260 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31486b7e-069e-44bb-a8e5-49943e36110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:47.542406 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-31486b7e-069e-44bb-a8e5-49943e36110e None None] MFA Rules not processed for user `f90bc834d17d440dbebeacfbeb7f08b8`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:47.543646 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-31486b7e-069e-44bb-a8e5-49943e36110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:47.549701 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:47.620868 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1485/2980] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:47.636503 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:47.638356 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:47.718990 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2eee-8b45-4c8d-b392-7c8882311045 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:47.724452 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd0c3-74d8-46dc-b70e-7d460f1199bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:47.725104 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd0c3-74d8-46dc-b70e-7d460f1199bb service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:47.725395 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd0c3-74d8-46dc-b70e-7d460f1199bb service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:47.725677 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd0c3-74d8-46dc-b70e-7d460f1199bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:47.781444 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd0c3-74d8-46dc-b70e-7d460f1199bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:47.783139 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd0c3-74d8-46dc-b70e-7d460f1199bb service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:47.792212 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1496/2981] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:51.441251 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b186df-7962-4b3f-84a1-3edd894df2f8 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:51.441728 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b186df-7962-4b3f-84a1-3edd894df2f8 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:51.441846 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b186df-7962-4b3f-84a1-3edd894df2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:51.459290 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-f3b186df-7962-4b3f-84a1-3edd894df2f8 None None] MFA Rules not processed for user `9c34e002e19c4a31920483dffc686b68`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:51.460477 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f3b186df-7962-4b3f-84a1-3edd894df2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:51.467762 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1486/2982] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:48:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:51.789448 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd0c3-74d8-46dc-b70e-7d460f1199bb service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:51.843477 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:51.848768 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd0c3-74d8-46dc-b70e-7d460f1199bb service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:51.852485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:51.854526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:51.854526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:51.854526 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:51.855613 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:51.866290 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:51.867766 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:51.877363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1497/2983] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:53.299654 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b186df-7962-4b3f-84a1-3edd894df2f8 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:53.301289 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f3b186df-7962-4b3f-84a1-3edd894df2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:53.371591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b186df-7962-4b3f-84a1-3edd894df2f8 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:53.376721 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:53.377376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:53.377786 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:53.378071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:53.379890 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:53.392458 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:53.394740 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:53.406242 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1487/2984] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:01.908289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=5 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:03.402193 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=61 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:06.962419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:06.976032 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e4e71-0944-4a6a-8bb5-68c842976479 service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:06.982501 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:06.983146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:06.983436 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:06.983720 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:06.985621 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:06.999119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:07.000689 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:07.011860 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1498/2985] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:09.664628 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:09.666073 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:09.677201 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffdf17-c8d2-4ace-bf78-a1d65de97b2a service placement] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:09.680757 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df7469-0522-4501-81c5-51d76b9c2793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:09.681392 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7469-0522-4501-81c5-51d76b9c2793 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:09.681677 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7469-0522-4501-81c5-51d76b9c2793 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:09.681953 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7469-0522-4501-81c5-51d76b9c2793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:09.691393 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df7469-0522-4501-81c5-51d76b9c2793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:09.693068 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df7469-0522-4501-81c5-51d76b9c2793 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:09.703100 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1488/2986] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:11.611140 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:11.612775 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:11.627370 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16517fc8-b6c5-49cb-8b05-0be313325a6d service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:11.632889 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:11.633521 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:11.633807 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:11.634083 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:11.636411 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:11.648377 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:11.649916 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:11.660519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1499/2987] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:19.698578 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:21.656107 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=12 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:54.017035 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0c436-e1ea-41a6-89a7-a84ba13cbc16 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:54.017507 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0c436-e1ea-41a6-89a7-a84ba13cbc16 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:54.017618 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0c436-e1ea-41a6-89a7-a84ba13cbc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.045917 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-4bc0c436-e1ea-41a6-89a7-a84ba13cbc16 None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:54.047230 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-4bc0c436-e1ea-41a6-89a7-a84ba13cbc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:54.072795 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1489/2988] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Jul 11 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:54.084947 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:54.104529 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f728-adeb-4f70-adc8-579c6a3ade11 service nova] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:54.108161 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd75ed0-5160-4217-a833-5d5652957266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:54.108824 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd75ed0-5160-4217-a833-5d5652957266 service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:54.109111 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd75ed0-5160-4217-a833-5d5652957266 service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:54.109392 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd75ed0-5160-4217-a833-5d5652957266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.116473 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd75ed0-5160-4217-a833-5d5652957266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:54.117901 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd75ed0-5160-4217-a833-5d5652957266 service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:54.125653 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1500/2989] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:51:04.070781 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=16 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:04.122318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=11 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:06.667370 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79483132-44a5-44fd-92fd-1f8591b1babb None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:06.667980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79483132-44a5-44fd-92fd-1f8591b1babb None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:06.667980 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79483132-44a5-44fd-92fd-1f8591b1babb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:06.686059 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-79483132-44a5-44fd-92fd-1f8591b1babb None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:06.687257 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-79483132-44a5-44fd-92fd-1f8591b1babb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:06.717946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1490/2990] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jul 11 15:51:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:06.724238 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c5d8-dc06-4d7b-8064-f74f2517f019 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:06.724705 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c5d8-dc06-4d7b-8064-f74f2517f019 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:06.724825 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c5d8-dc06-4d7b-8064-f74f2517f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:06.743683 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6a66c5d8-dc06-4d7b-8064-f74f2517f019 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:06.744903 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6a66c5d8-dc06-4d7b-8064-f74f2517f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:06.754387 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1501/2991] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:51:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:06.766067 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97875e5e-1646-48fe-93f7-693faf8e75a4 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:06.766383 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97875e5e-1646-48fe-93f7-693faf8e75a4 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:06.766664 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97875e5e-1646-48fe-93f7-693faf8e75a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:06.815790 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-97875e5e-1646-48fe-93f7-693faf8e75a4 None None] MFA Rules not processed for user `d42bb727957e40dca943c47785819223`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:06.817001 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-97875e5e-1646-48fe-93f7-693faf8e75a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:06.875284 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1491/2992] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Jul 11 15:51:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:06.880966 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66c5d8-dc06-4d7b-8064-f74f2517f019 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:06.889976 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66c5d8-dc06-4d7b-8064-f74f2517f019 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:06.893644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a203b8-f3e1-496c-901b-d4a5742caca5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42bb727957e40dca943c47785819223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:06.894309 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a203b8-f3e1-496c-901b-d4a5742caca5 service glance] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:06.894599 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a203b8-f3e1-496c-901b-d4a5742caca5 service glance] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:06.894879 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a203b8-f3e1-496c-901b-d4a5742caca5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:06.905209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a203b8-f3e1-496c-901b-d4a5742caca5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:06.906696 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a203b8-f3e1-496c-901b-d4a5742caca5 service glance] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:06.917246 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1502/2993] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:51:12.072569 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62fc7-be83-44f2-8a9f-df7d888b3b36 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:12.073071 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62fc7-be83-44f2-8a9f-df7d888b3b36 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:12.073182 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62fc7-be83-44f2-8a9f-df7d888b3b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:12.122663 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-31e62fc7-be83-44f2-8a9f-df7d888b3b36 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:12.123876 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-31e62fc7-be83-44f2-8a9f-df7d888b3b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:12.191178 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1492/2994] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:12.342820 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1fbd-db82-45e4-89c2-abad9f9116f6 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:12.343297 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1fbd-db82-45e4-89c2-abad9f9116f6 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:12.343405 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1fbd-db82-45e4-89c2-abad9f9116f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:12.391644 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-2efd1fbd-db82-45e4-89c2-abad9f9116f6 None None] MFA Rules not processed for user `0c3a489751424d008dbfefa89d19883a`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:12.392865 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-2efd1fbd-db82-45e4-89c2-abad9f9116f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:12.464263 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1503/2995] 10.222.0.20 () {58 vars in 1039 bytes} [Mon Jul 11 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:12.472374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e62fc7-be83-44f2-8a9f-df7d888b3b36 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:12.482368 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e62fc7-be83-44f2-8a9f-df7d888b3b36 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:12.487250 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430b62d-1022-4390-9587-4a531a7db5ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:12.487888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b62d-1022-4390-9587-4a531a7db5ee service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:12.488175 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b62d-1022-4390-9587-4a531a7db5ee service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:12.488486 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b62d-1022-4390-9587-4a531a7db5ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:12.497151 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430b62d-1022-4390-9587-4a531a7db5ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:12.498831 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430b62d-1022-4390-9587-4a531a7db5ee service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:12.507978 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1493/2996] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:51:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:13.570591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b0028-3d7e-43e6-9ab7-60aa09666bed None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:13.571105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b0028-3d7e-43e6-9ab7-60aa09666bed None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:13.571298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b0028-3d7e-43e6-9ab7-60aa09666bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:13.619130 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-7f1b0028-3d7e-43e6-9ab7-60aa09666bed None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:13.621883 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-7f1b0028-3d7e-43e6-9ab7-60aa09666bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:13.636294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1504/2997] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:51:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:13.653462 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b595c0-f06c-4ba5-a837-a400ebc9e41d None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:13.653924 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b595c0-f06c-4ba5-a837-a400ebc9e41d None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:13.654022 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b595c0-f06c-4ba5-a837-a400ebc9e41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:13.673950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-68b595c0-f06c-4ba5-a837-a400ebc9e41d None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:13.675576 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-68b595c0-f06c-4ba5-a837-a400ebc9e41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:13.688946 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1494/2998] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jul 11 15:51:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:13.695869 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b0028-3d7e-43e6-9ab7-60aa09666bed None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:13.710277 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b0028-3d7e-43e6-9ab7-60aa09666bed None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:13.716719 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc10151-7f6e-4b53-a19a-bf63e72873bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:13.717617 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc10151-7f6e-4b53-a19a-bf63e72873bd service nova] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:13.717754 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc10151-7f6e-4b53-a19a-bf63e72873bd service nova] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:13.718519 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc10151-7f6e-4b53-a19a-bf63e72873bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:13.729358 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc10151-7f6e-4b53-a19a-bf63e72873bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:13.735428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc10151-7f6e-4b53-a19a-bf63e72873bd service nova] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:13.756856 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1505/2999] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:23.029048 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2c74-e338-4fbf-a51c-cd8389d0dd94 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:23.029597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2c74-e338-4fbf-a51c-cd8389d0dd94 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:23.029597 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2c74-e338-4fbf-a51c-cd8389d0dd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:23.035944 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=100 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:23.048301 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-855e2c74-e338-4fbf-a51c-cd8389d0dd94 None None] MFA Rules not processed for user `9c34e002e19c4a31920483dffc686b68`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:23.051113 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-855e2c74-e338-4fbf-a51c-cd8389d0dd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:23.056655 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1495/3000] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jul 11 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:23.363988 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005494a-b110-482c-a1bd-3e2d40127ea9 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:23.364496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005494a-b110-482c-a1bd-3e2d40127ea9 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:23.364604 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005494a-b110-482c-a1bd-3e2d40127ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:23.400146 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-e005494a-b110-482c-a1bd-3e2d40127ea9 None None] MFA Rules not processed for user `092f588c7472454c8a6f435525e40a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:23.401342 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-e005494a-b110-482c-a1bd-3e2d40127ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:23.407709 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1506/3001] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:23.419109 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e2c74-e338-4fbf-a51c-cd8389d0dd94 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:23.429018 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e2c74-e338-4fbf-a51c-cd8389d0dd94 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:23.432625 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71eb5-cdf9-47e5-8ab9-c8a1890490e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:23.433256 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71eb5-cdf9-47e5-8ab9-c8a1890490e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:23.433537 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71eb5-cdf9-47e5-8ab9-c8a1890490e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:23.433809 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71eb5-cdf9-47e5-8ab9-c8a1890490e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:23.442330 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d71eb5-cdf9-47e5-8ab9-c8a1890490e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:23.446054 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d71eb5-cdf9-47e5-8ab9-c8a1890490e7 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:23.451609 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1496/3002] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:51:23.866924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84af9f-e799-4638-89b1-fa138f8cac7d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:23.867313 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84af9f-e799-4638-89b1-fa138f8cac7d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:23.867622 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84af9f-e799-4638-89b1-fa138f8cac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:23.887066 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-4f84af9f-e799-4638-89b1-fa138f8cac7d None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:23.888278 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-4f84af9f-e799-4638-89b1-fa138f8cac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:23.898488 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1507/3003] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:23.909742 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71eb5-cdf9-47e5-8ab9-c8a1890490e7 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:23.918152 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71eb5-cdf9-47e5-8ab9-c8a1890490e7 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:23.922657 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffbbde-0492-4383-9d48-8ad61e06a4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:23.923327 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffbbde-0492-4383-9d48-8ad61e06a4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:23.923732 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffbbde-0492-4383-9d48-8ad61e06a4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:23.923835 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffbbde-0492-4383-9d48-8ad61e06a4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:23.934659 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffbbde-0492-4383-9d48-8ad61e06a4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:23.936090 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffbbde-0492-4383-9d48-8ad61e06a4f9 service neutron] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:23.947894 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1497/3004] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:26.394863 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc579709-40db-425c-bfeb-12bdf3ad0740 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:26.395335 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc579709-40db-425c-bfeb-12bdf3ad0740 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:26.395491 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc579709-40db-425c-bfeb-12bdf3ad0740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:26.414402 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-fc579709-40db-425c-bfeb-12bdf3ad0740 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:26.415724 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-fc579709-40db-425c-bfeb-12bdf3ad0740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:26.423369 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1508/3005] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:26.435459 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffbbde-0492-4383-9d48-8ad61e06a4f9 service neutron] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:26.447787 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffbbde-0492-4383-9d48-8ad61e06a4f9 service neutron] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:26.452872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0a99-70e6-4e31-8bbc-45341b100790 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:26.453800 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0a99-70e6-4e31-8bbc-45341b100790 service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:26.454236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0a99-70e6-4e31-8bbc-45341b100790 service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:26.454542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0a99-70e6-4e31-8bbc-45341b100790 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:26.463317 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd0a99-70e6-4e31-8bbc-45341b100790 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:26.464888 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd0a99-70e6-4e31-8bbc-45341b100790 service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:26.474023 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1498/3006] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:51:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:36.408991 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=83 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:36.470546 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=20 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:37.526479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66aa4-9be4-4987-bb01-7dcedc49ec56 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:37.526986 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66aa4-9be4-4987-bb01-7dcedc49ec56 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:37.530289 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66aa4-9be4-4987-bb01-7dcedc49ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:37.555915 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-06e66aa4-9be4-4987-bb01-7dcedc49ec56 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:37.557219 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-06e66aa4-9be4-4987-bb01-7dcedc49ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:37.567560 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1509/3007] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:51:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:37.580187 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0a99-70e6-4e31-8bbc-45341b100790 service swift] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:37.592754 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0a99-70e6-4e31-8bbc-45341b100790 service swift] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:37.599523 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ff1ce-f342-446b-bcae-a2edf1a9d186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:37.600216 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ff1ce-f342-446b-bcae-a2edf1a9d186 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:37.600468 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ff1ce-f342-446b-bcae-a2edf1a9d186 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:37.600750 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ff1ce-f342-446b-bcae-a2edf1a9d186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:37.610810 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ff1ce-f342-446b-bcae-a2edf1a9d186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:37.612489 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ff1ce-f342-446b-bcae-a2edf1a9d186 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:37.624214 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1499/3008] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:47.542542 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:47.619381 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:48.612839 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6328e-1ccf-4c3b-8566-534b8120cd63 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:48.613361 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6328e-1ccf-4c3b-8566-534b8120cd63 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:48.613570 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6328e-1ccf-4c3b-8566-534b8120cd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:48.631456 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-04b6328e-1ccf-4c3b-8566-534b8120cd63 None None] MFA Rules not processed for user `035eeee0a72449358827a34bb09aa057`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:48.632673 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-04b6328e-1ccf-4c3b-8566-534b8120cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:48.644498 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1510/3009] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:51:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:48.657101 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ff1ce-f342-446b-bcae-a2edf1a9d186 service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:48.668041 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ff1ce-f342-446b-bcae-a2edf1a9d186 service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:48.673561 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ada1f-45cc-4ae3-bdec-1de4673d89a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:48.674236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ada1f-45cc-4ae3-bdec-1de4673d89a7 service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:48.674517 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ada1f-45cc-4ae3-bdec-1de4673d89a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:48.674807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ada1f-45cc-4ae3-bdec-1de4673d89a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:48.684019 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ada1f-45cc-4ae3-bdec-1de4673d89a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:48.685590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ada1f-45cc-4ae3-bdec-1de4673d89a7 service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:48.696969 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1500/3010] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:51:58.626005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:58.692376 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:24.008363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf397c-2d91-4620-b388-7236f529607d None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:24.008891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf397c-2d91-4620-b388-7236f529607d None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:24.008891 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf397c-2d91-4620-b388-7236f529607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:24.026992 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-d8cf397c-2d91-4620-b388-7236f529607d None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:24.028182 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-d8cf397c-2d91-4620-b388-7236f529607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:24.035670 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1511/3011] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jul 11 15:53:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:24.077864 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ada1f-45cc-4ae3-bdec-1de4673d89a7 service nova] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:24.090504 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ada1f-45cc-4ae3-bdec-1de4673d89a7 service nova] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:24.095644 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa66c56-9b20-4ddd-b213-c08c4a885561 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:24.100807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66c56-9b20-4ddd-b213-c08c4a885561 service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:24.100807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66c56-9b20-4ddd-b213-c08c4a885561 service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:24.100807 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66c56-9b20-4ddd-b213-c08c4a885561 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:24.106780 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa66c56-9b20-4ddd-b213-c08c4a885561 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:24.108566 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa66c56-9b20-4ddd-b213-c08c4a885561 service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:24.117635 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1501/3012] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:53:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:53:34.021985 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=3 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:34.114038 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=6 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:34.760971 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddc12-aece-4fae-b994-a89a37dd5e08 None None] REQUEST_METHOD: `POST` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:34.761265 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddc12-aece-4fae-b994-a89a37dd5e08 None None] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:34.761546 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddc12-aece-4fae-b994-a89a37dd5e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:34.779591 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.auth.core [None req-6fcddc12-aece-4fae-b994-a89a37dd5e08 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:34.780791 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-6fcddc12-aece-4fae-b994-a89a37dd5e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:34.787970 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1512/3013] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jul 11 15:53:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:34.800191 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa66c56-9b20-4ddd-b213-c08c4a885561 service swift] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:34.811279 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa66c56-9b20-4ddd-b213-c08c4a885561 service swift] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:34.817562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbddd9d-006a-4a00-9343-9335894eec07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:34.817562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbddd9d-006a-4a00-9343-9335894eec07 service swift] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:34.817562 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbddd9d-006a-4a00-9343-9335894eec07 service swift] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:34.818583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbddd9d-006a-4a00-9343-9335894eec07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:34.826792 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbddd9d-006a-4a00-9343-9335894eec07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:34.828367 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbddd9d-006a-4a00-9343-9335894eec07 service swift] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:34.837300 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1502/3014] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:53:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:53:39.811005 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcddc12-aece-4fae-b994-a89a37dd5e08 None None] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:39.832876 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcddc12-aece-4fae-b994-a89a37dd5e08 None None] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:39.838475 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:39.839105 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:39.839389 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:39.839666 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:39.841397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:39.864870 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:39.866434 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:39.876148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1513/3015] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:40.457875 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f75664-9d1c-464e-adfd-5a0a5b5a21a2 None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:40.458374 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f75664-9d1c-464e-adfd-5a0a5b5a21a2 None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:40.458591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f75664-9d1c-464e-adfd-5a0a5b5a21a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:40.476446 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-b2f75664-9d1c-464e-adfd-5a0a5b5a21a2 None None] MFA Rules not processed for user `159886720aa34b75b1ca092e1477b17e`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:40.477641 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-b2f75664-9d1c-464e-adfd-5a0a5b5a21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:40.484773 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1503/3016] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jul 11 15:53:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:40.497367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:40.508682 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cfc0f-cc84-4504-9459-dff104597ca4 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:40.513640 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af12eb-0471-4ed9-95e4-d20517569862 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3a489751424d008dbfefa89d19883a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:40.514337 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af12eb-0471-4ed9-95e4-d20517569862 service swift] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:40.514626 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af12eb-0471-4ed9-95e4-d20517569862 service swift] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:40.514909 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af12eb-0471-4ed9-95e4-d20517569862 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:40.522949 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af12eb-0471-4ed9-95e4-d20517569862 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:40.524516 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af12eb-0471-4ed9-95e4-d20517569862 service swift] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:40.532920 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1514/3017] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jul 11 15:53:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:53:46.853467 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f75664-9d1c-464e-adfd-5a0a5b5a21a2 None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:46.866481 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f75664-9d1c-464e-adfd-5a0a5b5a21a2 None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:46.871950 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc51c9-c159-428a-a295-468aada4cf1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '035eeee0a72449358827a34bb09aa057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:46.872591 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc51c9-c159-428a-a295-468aada4cf1b service nova] REQUEST_METHOD: `GET` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:46.872877 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc51c9-c159-428a-a295-468aada4cf1b service nova] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:46.873155 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc51c9-c159-428a-a295-468aada4cf1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:46.880931 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc51c9-c159-428a-a295-468aada4cf1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:46.882564 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc51c9-c159-428a-a295-468aada4cf1b service nova] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:46.891436 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1504/3018] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:48.254419 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af12eb-0471-4ed9-95e4-d20517569862 service swift] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:48.274433 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af12eb-0471-4ed9-95e4-d20517569862 service swift] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:48.278011 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0be5-905e-45c0-acb6-035edb6bc3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f588c7472454c8a6f435525e40a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:48.278671 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0be5-905e-45c0-acb6-035edb6bc3aa service neutron] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:48.278956 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0be5-905e-45c0-acb6-035edb6bc3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:48.279235 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0be5-905e-45c0-acb6-035edb6bc3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:48.338781 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf0be5-905e-45c0-acb6-035edb6bc3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:48.340200 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf0be5-905e-45c0-acb6-035edb6bc3aa service neutron] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:48.349885 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1515/3019] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:51.567082 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b158b24-85df-4c2d-b9e2-0425d251664a None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:51.567968 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b158b24-85df-4c2d-b9e2-0425d251664a None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:51.569872 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b158b24-85df-4c2d-b9e2-0425d251664a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:51.586952 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-5b158b24-85df-4c2d-b9e2-0425d251664a None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:51.588235 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-5b158b24-85df-4c2d-b9e2-0425d251664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:51.597163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1505/3020] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jul 11 15:53:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:51.618756 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0be5-905e-45c0-acb6-035edb6bc3aa service neutron] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:51.629805 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0be5-905e-45c0-acb6-035edb6bc3aa service neutron] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:51.634852 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb3d10-27c1-4e84-9c64-9a35c26cf375 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:51.635485 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3d10-27c1-4e84-9c64-9a35c26cf375 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:51.635767 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3d10-27c1-4e84-9c64-9a35c26cf375 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:51.636044 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3d10-27c1-4e84-9c64-9a35c26cf375 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:51.644623 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb3d10-27c1-4e84-9c64-9a35c26cf375 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:51.646762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb3d10-27c1-4e84-9c64-9a35c26cf375 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:51.656509 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1516/3021] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:55.100590 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b158b24-85df-4c2d-b9e2-0425d251664a None None] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:55.111470 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b158b24-85df-4c2d-b9e2-0425d251664a None None] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:55.116288 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:55.117165 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:55.117579 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:55.118046 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] PATH_INFO: `/v3/users/9c34e002e19c4a31920483dffc686b68` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:55.119329 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c34e002e19c4a31920483dffc686b68)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:55.121295 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:55.338051 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c34e002e19c4a31920483dffc686b68'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.445318 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c34e002e19c4a31920483dffc686b68'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.459057 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c34e002e19c4a31920483dffc686b68'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.459753 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c34e002e19c4a31920483dffc686b68'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.466683 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c34e002e19c4a31920483dffc686b68'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.472542 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1506/3022] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:53:55 2022] DELETE /identity/v3/users/9c34e002e19c4a31920483dffc686b68 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:55.719908 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb3d10-27c1-4e84-9c64-9a35c26cf375 service placement] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:55.729495 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb3d10-27c1-4e84-9c64-9a35c26cf375 service placement] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:55.786363 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:55.787762 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:55.788042 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:55.788316 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] PATH_INFO: `/v3/projects/04a4e75acf2b47c0911f5e9a803ae817` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:55.789479 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a4e75acf2b47c0911f5e9a803ae817)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:55.791428 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:55.814318 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=100 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:55.889298 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a4e75acf2b47c0911f5e9a803ae817', 'request_id': 'req-b7615c64-1983-4b38-8206-5f9c8bdc0655'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.981545 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a4e75acf2b47c0911f5e9a803ae817', 'request_id': 'req-b7615c64-1983-4b38-8206-5f9c8bdc0655'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.988427 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a4e75acf2b47c0911f5e9a803ae817', 'request_id': 'req-b7615c64-1983-4b38-8206-5f9c8bdc0655'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.998830 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] The token cache is being invalidate because project 04a4e75acf2b47c0911f5e9a803ae817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:53:55.999119 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:55.999750 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.001304 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1517/3023] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:53:55 2022] DELETE /identity/v3/projects/04a4e75acf2b47c0911f5e9a803ae817 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:56.005236 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] Authenticating user token {{(pid=87428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:56.006696 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:56.019583 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a730e46-881d-43d4-b77e-c4a7dffdc9e7 admin admin] Validating token access rules against request {{(pid=87428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:56.075468 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:56.076328 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:56.076611 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:56.076887 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] PATH_INFO: `/v3/users/f90bc834d17d440dbebeacfbeb7f08b8` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:56.078066 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90bc834d17d440dbebeacfbeb7f08b8)` {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:56.080047 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] RBAC: Authorization granted {{(pid=87428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:56.255261 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:56.264843 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90bc834d17d440dbebeacfbeb7f08b8'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.342163 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90bc834d17d440dbebeacfbeb7f08b8'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.354404 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90bc834d17d440dbebeacfbeb7f08b8'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.355032 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90bc834d17d440dbebeacfbeb7f08b8'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.361776 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.notifications [None req-a57a9644-358a-4e9c-97bb-6e8421e77fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90bc834d17d440dbebeacfbeb7f08b8'} {{(pid=87428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.367614 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1507/3024] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jul 11 15:53:56 2022] DELETE /identity/v3/users/f90bc834d17d440dbebeacfbeb7f08b8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:56.615496 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:56.617562 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:56.631101 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7615c64-1983-4b38-8206-5f9c8bdc0655 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:56.692294 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93482eec3eb5456081aa49110195cd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ad6c08bb2467485d9a32d65d47482', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:56.693209 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:56.693500 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:56.693782 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] PATH_INFO: `/v3/projects/305255994aa844b394de283103f4df50` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:56.695662 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=305255994aa844b394de283103f4df50)` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:56.697615 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:56.802730 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305255994aa844b394de283103f4df50', 'request_id': 'req-44d97708-9d4f-4694-a5a6-a04595ea1853'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.867726 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305255994aa844b394de283103f4df50', 'request_id': 'req-44d97708-9d4f-4694-a5a6-a04595ea1853'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.874330 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305255994aa844b394de283103f4df50', 'request_id': 'req-44d97708-9d4f-4694-a5a6-a04595ea1853'} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.885222 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] The token cache is being invalidate because project 305255994aa844b394de283103f4df50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:53:56.885511 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.886173 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.notifications [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:56.887715 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1518/3025] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jul 11 15:53:56 2022] DELETE /identity/v3/projects/305255994aa844b394de283103f4df50 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:54:06.439104 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:06.881561 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:00.299181 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374a5f-d404-46fa-b4ba-a484f5f6c62b None None] REQUEST_METHOD: `POST` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:00.299673 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374a5f-d404-46fa-b4ba-a484f5f6c62b None None] SCRIPT_NAME: `/identity` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:00.299806 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374a5f-d404-46fa-b4ba-a484f5f6c62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:00.355419 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.auth.core [None req-f3374a5f-d404-46fa-b4ba-a484f5f6c62b None None] MFA Rules not processed for user `db2728bb6856484b853191e75fa49f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:00.356694 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG keystone.common.fernet_utils [None req-f3374a5f-d404-46fa-b4ba-a484f5f6c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:00.418735 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: [pid: 87428|app: 0|req: 1508/3026] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Jul 11 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:00.424777 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] Authenticating user token {{(pid=87427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:00.436271 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d97708-9d4f-4694-a5a6-a04595ea1853 admin admin] Validating token access rules against request {{(pid=87427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:00.441893 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1be27b-c0d7-4de6-a382-3eeb130f9838 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2728bb6856484b853191e75fa49f93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24e01825c6f345739df1926c594ccb50', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:00.442564 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1be27b-c0d7-4de6-a382-3eeb130f9838 service placement] REQUEST_METHOD: `GET` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:00.442862 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1be27b-c0d7-4de6-a382-3eeb130f9838 service placement] SCRIPT_NAME: `/identity` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:00.443148 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1be27b-c0d7-4de6-a382-3eeb130f9838 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:00.444924 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.fernet_utils [None req-cf1be27b-c0d7-4de6-a382-3eeb130f9838 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:00.456686 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1be27b-c0d7-4de6-a382-3eeb130f9838 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:00.458397 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1be27b-c0d7-4de6-a382-3eeb130f9838 service placement] RBAC: Authorization granted {{(pid=87427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:00.468506 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: [pid: 87427|app: 0|req: 1519/3027] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:10.409912 dv-neutron-master-2-hyperv devstack@keystone.service[87428]: DEBUG dbcounter [-] [87428] Writing DB stats keystone:SELECT=43 {{(pid=87428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:10.464367 dv-neutron-master-2-hyperv devstack@keystone.service[87427]: DEBUG dbcounter [-] [87427] Writing DB stats keystone:SELECT=6 {{(pid=87427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}